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FOREWORD 



In studying human talents the dimension of growth is an important one. 

Most studies of the organization of mental abilities have been limited to 
a single set of measurements taken at one point in time. 

The data collected in March of 1960 by the Project TALENT staff 
represented one large effort to obtain rather extensive data on a representative 
sample of American high school students. 

In 1963 it was proposed that in order to gain some depth in this survey 
and to obtain a better understanding of the nature of the growth of these 
variables and their interrelations over time, a sample should be retested. 

In this report Miss Marion F. Shaycoft presents the results of this 
study including a variety of new or newly adapted statistical analysis procedures 
to clarify insofar as possible the nature of these cognitive variables and 
their growth during the high school years. This report represents an important 
contribution to the understanding of the basic cognitive measures on which 
the future follow-ups of Project TALENT will depend. It also is concerned 
with some very important problems and issues in education and individual 
development. Although it does not provide definitive answers to these 
questions it does make important contributions to improved understanding of 
student growth and development. 

It is hoped that the publication of this report will move us a step 
closer to the fundamental understanding of measurement and prediction 
procedures which will assist the young people of the future to identify, 
develop, and utilize their talents to the fullest extent possible. 

John C. Flanagan 



30 January 1967 
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Chapter 1. AN OVERVIEW 



This report is concerned with a study that is a small segment of a 
larger-scale study— Project TALENT. Project TALENT, which provides the basic 
framework into which the retest study fits, is described in the next section. 
The description is brief because the project is so fully described elsewhere 
(Flanagan et al.^ 1960, 1962a, 1962b, 1964, 1966, Shaycoft et at., 1963). 

PROJECT TALENT; AN OVERVIEW 



In the seemingly endless debates over the relative merits of large-scale 
cross-sectional studies and smaller but more intensive longitudinal studies, 
neither side has a decisive advantage over the other. The balance tilts 
first one way, then the other, as relative costs are weighed and the ques- 
tions that each kind of study will answer are compared. 

Project TALENT is a cross between the two approaches — and as a result it 
has most of the important advantages of each. In brief. Project TALENT is 
a large-scale cross-sectional study, in which almost half a million students 
in four grades (9-12) in over a thousand secondary schools, public, parochial, 
and private, in all parts of the country were given a broad-scope battery 
of tests requiring two full days of testing. But it is also a longitudinal 
study since the plans call for periodic questionnaire follow-ups of the sub- 
jects, for as long as 20 years after high school graduation. 

The group tested includes over 400,000 students constituting a probabil- 
ity sample of all students in grades 9, 10, ^11, 12 in public and nonpublic sec- 
ondary schools in the United States in the spring of 1960. In addition, an 
effort was made at the same time to supplement this sample with a probabil- 
ity sample of all 15-year-olds in the United States, whether or not they hap- 
pened to be in the grade 9-12 range. The resulting supplementary group of 
15-year-olds not in grades 9-12 was also tested at the same time as the main 
group, in the spring of 1960. 
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The Project TALENT battery', given at that time, included a wide variety 
of aptitude and achievement tests, sampled information in many areas, both 
academic and nonacademic, and also included a questionnaire on vocational 
interests (the Interest Inventory), a personality inventory (the Student 
Activities Inventory) , and a biographical questionnaire (the Student Informa- 
tion Blank) containing nearly 400 questions about the student's background — 
his school life, his out-of-school activities, his general health, his plans 
and aspirations, his home, and his family. 

Participants are being followed up periodically by questionnaire to find 
out about their post-high-school studies, jobs, career plans, their marital 
status, and other aspects of what they have been doing and what they plan 
to do. Each participant was sent a questionnaire 1 year after his class gradu- 
ated from high school. Another questionnaire is sent 5 years after high school 
graduation. (This is the current phase of the follow-up.) It is also planned 
that questionnaires will be sent 10 and 20 years after high-school graduation. 

Although the kinds of research for which the Project TALENT data can be 
and has been used continue to expand, the original purposes of the project, 
which still serve to determine its direction and long-range goals, are worth 
restating. They are: 

1. To develop an inventory of human resources — or, more specifically, 
of the capacities and potentials of the nation's youth. 

2. To develop a set of standards for educational and psychological 
measurement. 

3. To develop a comprehensive counseling procedure for guiding students 
toward various careers,. 

4. To gain a better understanding of how young people choose their life 
work. 

5. To gain a better understanding of the educational experiences which 
prepare young people for their life work. 

THE RETEST STUDY: AN OVERVIEW 

The retest study involves over 10,000 students constituting the entire 
12th-grade enrollment in over 100 high schools, in all parts of the country, 
who were given a full day of testing and for most of whom records were avail- 

^Details about the composition of the TALENT battery are given in Appendix B. 



able on the full 2 days of Project TALENT tests and Inventories they had com- 
pleted 3 years earlier, in grade 9. 

The size and nationwide character of the sample, the fact that it involves 
data collected on the same group at two different times a full 3 years apart, 

and the wide range of aptitudes, abilities, areas of achievement, interests, 
and background characteristics covered by the battery of tests and inventor- 
ies invest the resulting body of raw data with an enormous potential for yield- 
ing answers to important questions about American high school students and 
the kinds of changes that may take place in their abilities, achievement 
levels, interests, plans, and actions during the last 3 years of high school. 

Of particular interest in this connection is the potential for going 
beyond mere description of the nature and magnitude of the changes occurring. 

Of far more importance, of course, is an understanding of the factors that 
promote these changes, and the factors that inhibit them. And the data 
available on the retested students, when suitably analyzed, can yield useful 
insights into the nature of these factors. 

THIS REPORT; AN OVERVIEW 

As was implied in the previous section, the purpose of this report and 
of the study it presents is multi-faceted. Broadly speaking, the purpose 
first and foremost is to tell us something about the students. Secondly the 
report is intended to shed some light on the schools; this is indirect 
light — reflected from the students. In other words, the findings about students 
from different schools permit us to draw some conclusions about the schools 
from which they come. The third purpose, which is distinctly subordinate to 
the other two, is to present some findings about the tests themselves — what 
they measure, how they measure it, and how well they measure it. 

These latter findings are of interest in the present study primarily 

) 

because they help us to interpret the first two kinds of findings — those 
.about the students and those about the schools. But the findings about the 
tests also have a somewhat broader purpose since they are relevant not only 
to the interpretation of the retest results concerning students and schools 
that are the prima:^ content of the present report, but also, presumably, 
to any other research, past or future, based on the Project TALENT data. 



The findings about the students derive mostly from analyses, both simple 
and complex, of the relationships between the relative standing of students 
in some respect in grade 9 and their relative standing in that or some other 
relevant respect in grade 12* It is perhaps something less than startling 
that the resultant findings fall in two diametrically opposite categories'"*" 
simil arities between the grade 9 picture and the grade 12 picture, and 
differences . But it may be surprising that these two categories of findings—— 
the similarities and the differences— either answer or provide clues to the 
answers to two entirely different kinds of questions. Moreover both kinds 
of questions are important ones, fraught with significance. The findings 
about similarities tell us something about how well we can predict, at least 
3 years into the future, and what sorts of predictions are most accurate. 

The findings about differences are in some respects perhaps even more impor- 
tant because when properly used they give us some clues as to what sorts of 
intervening occurrences (school practices, for instance) are effective in 
bringing about desired changes and what sorts have no effect, or worse still, 
may have actively undesirable effects. 

The focus of the present report, as its title implies, is on the cogni- 
tive domain growth in abilities and achievement. Other studies, focusing on 
other aspects of the retest data, are covered in other reports! 

Having discussed the broad purposes of this report in the most general 
terms possible, let us return to the beginning and survey its content— still 
in broad terms but chapter by chapter. 

Chapter 2 presents the design of the retest study and explains how, 
basically, it grew out of the study’s purposes. 

Chapter 3 discusses some of the methodological problems, both statistical 
and psychometric, growing directly out of the purposes of the study or out of 
its design, or both. Not only are the problems considered in some detail but 
in most cases solutions are presented, which are utilized in obtaining the 
results reported in the later chapters. Not all methodological problems and 
issues discussed in this report are concentrated in Chapter 3, however. That 

chapter is limited to a consideration of somewhat general problems — problems 
that are at least general enough to apply to the substantive research in more 



See the section at the end of this chapter, entitled "Related Research on 
the Retest Data." 
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than one chapter of Part III. (Methodological problems that Insofar as the 
present report is concerned are applicable to only a single chapter are dis- 
cussed in that chapter, rather than in Chapter 3.) 

Part II, which consists of a single chapter. Chapter A, is concerned with 
the TALENT battery — ^not particularly in terms of its content, but in terms, 
rather, of its internal statistical characteristics. Such matters are con- 
sidered as test reliability, whether the tests that are supposed to be in 
effect unspeeded really operate that way, and whether the answer-sheet re- 
isipoijises are relatively free of clerical error. Not only are data presented in 
th^s chapter that are directly applicable in evaluating the findings presen- 
ted in Part III of the report, but other data are also presented (other relia- 
bility coefficients, for Instance) that are not directly relevant to the re- 
test study (though derived from it), but apply instead to analyses of the main 
body of Project TALENT data as presented in earlier reports, and are also 
appropriate for use in future analyses of mainline Project TALENT results. The 
reason these more accurate reliability estimates are presented here rather 
than in the earlier reports is that they couldn’t have been obtained without 
the retest data — because of hardware improvements that made it feasible to get 
the retest data on tape in a form that permitted the use of better formulas 
than could be used with the earlier kind of tape record! 

The findings of the study (except for those few areas of findings about 
the tests themselves, covered in Chapter 4) are presented in Part III of the 
report. The title of Part III, "The Students and the Schools," is probably 
self-explanatory. Chapter 5 is an overall survey of the changes in cognitive 
skills that occur between grades 9 and 12. Both the magnitude of these changes 
in various areas and their relation to initial level are investigated. The 
extent to which boys and girls differ in these respects is also considered. 

Chapter 6 is based primarily on factor analyses of the grade 9 and grade 

12 variables jointly, supplemented by canonical correlation analyses between 
the variables for the two grades. These Chapter 6 analyses, like most of those 

for the other chapters, are carried out separately for each sex. 

^For most of the tests in the 1960 Project TALENT testing, the hardware used 
was such that only total scores could be put on tape — not th& individual 
item responses. Thus the only formula that could be used for estimating the 
reliability of the tests from these original data was KR-21 (Kuder and Rich- 
ardson, 1937), a formula with serious limitations. 
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Chapter 7 seeks to determine whether there are differences among schools 
in their effects (and in their effectiveness in bringing about desired changes 
in the students). The chapter is based primarily on discriminant analysis and 
analysis of variance, both univariate and multivariate. Since Chapter 7 
demonstrates that schools ^ differ in their effects, Chapter 8 attempts to 
pin down the exact nature of some of the school characteristics that may be 
responsible for these differences. But in Chapter 8, unlike Chapter 7, the 
unit of study is the individual student not the school. The modalities used 
chiefly in Chapter 8 are part and partial correlation and (somewhat less 
importantly) partial canonical correlation. 

Chapter 9, which constitutes Part IV of the report, summarizes the out- 
lines of the study and presents some conclusions that result from an effort 
to pull together into a single unified whole the separate implications of the 
various chapters. 



The present report, obviously, doesn't even begin to exhaust the poten- 
tialities of the retest data as a source of insights into the nature and 
etiology of the changes that occur in American youth during the high school 
years. One major area not within the scope of the present report is analysis 
of changes in the student's interests, activities, and plans, as reported by 
him in the Interest Inventory and the Student Information Blank. Although 



some of these inventory responses have been utilized incidentally in the pre- 
sent study of mental growth, they themselves have not been the central theme 
of this report. That gap is filled by other studies. 

A monograph by William W. Cooley will focus on questions related to the 
stability of inventoried vocational interests. A major question considered in 
this monograph is whether or not abilities change during high school to be more 
consistent with 9th-grade interests or whether interests change during high 
school to be more consistent with 9th-grade abilities. Multivariate procedures 
are used to investigate four sets of variables Jointly: grade 9 interests, 

grade 9 abilities, grade 12 interests, and grade 12 abilities. Research hy- 
potheses are explored concerning the degree to which responses to vocational 
interest inventories are subject to change as the student matures and gains 
a more realistic picture of his own abilities and motives and those needed for 
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Chapter 2. DESIGN OF THE RETEST STUDY 



Since the design of a study, ideally, should depend largely on its 
purposes we shall start out in this chapter with a consideration of the 
general purposes of the retest study and how they differ from some of the 
general purposes of the "mainline" Project TALENT study. 

PURPOSES OF THE STUDY 



The primary purpose of the retest study was to study relationships 
rather than to develop norms. More specifically, the retest study was 
Intended to permit the investigation of relationships of various charac- 
teristics of the student in grade 12 to characteristics these same students 
possessed 3 years earlier, in grade 9, and also to the events of the inter- 
vening 3 years. 

This greater Interest in relationships than in absolute values (l.e., 
normative data) was not the result of any feeling that one type of informa- 
tion is intrinsically more important than the other. Rather it was due to 
a realization that the main Project TALENT sample had been designed with a 
view to making it as suitable as possible for use in normative studies. (Not 
only had it been selected in a way that Insured that it could be treated as 
a "probability sample^" but it was as representative of the population as 
feasible, and as large as necessary in order to provide adequate numbers 
of cases in basically unpopulous categories.) Therefore retesting a sub- 
sample of the Project TALENT sample would have been pointless if the new 
data were to be used primarily for normative purposes. But of course this 
wasn't the case. As has already been indicated, the retesting had as its 



This concept of a "probability sample" as it applies to Project TALENT is 
discussed briefly in Studies of a Complete Age Group — Age 15 (Shaycoft 
et at., 1963, pp. 5-7). The design and selection of the Project TALENT 
sample are discussed in considerable detail in Chapter III of Designing 
the Study (Flanagan et al,^ 1960) and in somewhat abridged form in Chapter 3 
of Design for a Study of American Youth (Flanagan et aZ., 1962). 



chief purpose to make it possible to find answers to important questions 
that couldn’t have been studied without retest data based on some of the 
students in the original TALENT sample. 

FACTORS DICTATING FEATURES OF THE DESIGN 



Desired Characteristics of the Sample 

Because investigation of relationships was a major purpose of the retest 
study, and because it was considered desirable to be able to have some con- 
fidence that the relationships found (or at least most of them) were 
applicable over a fairly broad segment of the high school population, it was 
regarded as important to have the retest sample include a wide variety of 
schools representing as many different strata in all respects as possible. 

But it wasn’t considered essential to form the sample as a "probability 
sample" with every unit of the population from which it was drawn having a 
known probability, greater than 0, of being selected, as it would have been 
for normative purposes. 

Desired Characteristics of the Retest Battery 

Content . Because of the very broad purposes of the retest study it was 
felt desirable to have most of the tests and inventories included in their 
original forms. Exceptions were made in the case of the Preferences Test, the 
Memory for Sentences Test, the Student Activities Inventory, the Student Informa- 
tion Blank, and the themes. (It was felt that the Preferences Test could not 
be readministered since the scoring procedure (score equals number of items 
answered), which had been a carefully guarded secret at the time of the original 
testing, was now known. Likewise the Student Activities Inventory was 
considered expendable in the interests of shortening the battery, and the 
Student Information Blank abridgeable . ) 

Organization . Although it was not regarded as necessary that everyone 
in the retest study take all of the tests included, the interest in correla- 
tional analyses dictated that for each pair of tests some group taking both 
should be included, so that it would be possible to obtain correlation 
coefficients between any pair of variables. 



Practical Limitations 



As in almost all research studies, practical considerations (such as time 
available, facilities, and budget) imposed some restrictions. The most 
important of these was the limitation on testing time required in each 
participating school. The TALENT battery, as originally administered in 
1960, required 2 full days. But only 1 day of retest time per school was 
deemed feasible, in order to make it comparatively easy for schools to 
participate. 

As for the overall size of the retest sample, it was restricted by 
practical considerations to roughly 10,000 students. 

DETAILS OF THE DESIGN 



The Seven Retest Batteries 

The Six Basic Retest Batteries . It is probably obvious from the fore- 
going discussion that if the retest study were to meet all the conditions 
established as desirable, it would necessarily require a fairly complicated 
design. 

If data were to be provided on all or almost all of the original tests. 

In their original form,, without requiring more than half as much time per 
student as was originally available, it was clear that participants could not 
all take the same set of tests. Furthermore, if the complete set of tests 
were merely divided into two subsets and half the retest students were given 
one subset and the other half the other, it would be impossible to get 
correlations between the tests in one set and those in the other. The 
simplest way to solve this problem was to divide the original 2 days of tests 
into four subsets, each requiring half a day. Combining any two of these 
four subsets would yield a full day of testing, and if all possible pairs of 
subsets were used, each pair being administered in a different set of schools, 
every test would be given in conjunction with every other, and all correla- 
tions would therefore be obtainable. 

Each pair of half-day subsets was accordingly organized into a "retest 
battery." Since there were six such pairs, six basic retest batteries were 
established. They were designated Batteries A, B, C, D, E, and F. 
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As an added refinement, it was considered desirable to select one test 
to be included in all six batteries. This test, if properly chosen, would 
be useful as a control variable in circumstances where it was necessary to 
determine the extent to which the groups taking the six batteries were not 
comparable, or as a basis for making some sort of statistical adjustment to 
make the groups more nearly comparable. It was felt these purposes would be 
best served if the test selected were one that was general in character (not 
a measure of achievement in a specific area) and had high correlation with 
general academic ability. The Abstract Reasoning Test was chosen for the 
purpose because it was the shortest of the tests that met the requirements 
stated above, adding less than 15 minutes to each retest battery. But even 
this short additional time, combined with the fact that all six batteries 
had to include time for filling out Record Form Z (the answer sheet contain- 
ing basic identifying information to make it possible to associate the 
student's retest record with the record of his original testing in grade 9) 
would have made the testing-time schedule for the six batteries unduly tight. 
To allow some leeway, therefore, the tests that were explicitly indicated in 
the previous section to be regarded as "expendable** — the Preferences Test and 
the Student Activities Inventory — were eliminated, as was the one additional 
test. Memory for Sentences, that seemed least needed. 

In addition, the Student Information Blank was revised and shortened 
drastically. (Revisions of the inventory included not only the elimination 
of a great many items but also the revision of some others and the addition 
of a few brand-new items.) 

The only other change was that one of the two brief ** themes** that the 
students had been required to write in grade 9 was replaced by a theme on a 
new topic. ^ 

Details about these changes are given in Appendix C-1. 



These themes have not been scored or processed in any other way, since they 
were not intended for inclusion in the analyses presented in this report. 
Instead, they have been earmarked for future use in small-scale gpecial- 
purpose studies. The topics of the themes are shown in- Appendix B (for the 
1960 testing) and in Appendix C-1 (for the 1963 testing). 






The tests Included in each of the six basic batteries (and also in a 
seventh battery, Battery V, explained below) are indicated in Appendix C-2. 



Battery V . Battery V was a special battery, requiring 1 day of testing, 
like the other six, but including a different combination of tests. This 
battery was designed primarily for use in a special project to collect data 
in vocational high schools. Strictly speaking, this special project had 
nothing to do with the retest study, although the testing phases of the two 
were carried out simultaneously. But ten of the high schools in the 
vocational-high-school testing were in New York City and therefore had par- 
ticipated in the original Project TALENT testing in 1960 (since all secondarjr 
schools in New York City had participated) . Since the same students were in- 
volved in the retesting in 1963, these ten New York City schools taking retest 
Battery V could be considered legitimate members of the retest sample, aug- 
menting the number of cases available for certain sub-studies. (They 
couldn’t have been so considered if it had been regarded as Important to have 
a probability sample for the retest study, but as has already been pointed 
out, it wasn’t.) The Battery V cases have therefore been regarded as quite 
suitable for inclusion in certain of the retest data analyses, while they have 
been omitted from others. The tests included in Battery V are indicated in 
Appendix C-2 . 

The Sample of Schools 

The retest study was limited to public secondary schools. For adminis- 
trative reasons it was considered not feasible to Include any schools from 
the five cities with a population over 1,500,000 (except for the New York City 
vocational high schools, already mentioned, in which Battery V was given). 
Except for this exclusion of nonpublic schools and schools in the largest 
cities, it was considered desirable to have all categories of secondary schools 
represented in the sample, insofar as possible. To help insure this, a 
secondary-school taxonomy^, developed several years ago, was used as the basis 



This secondary-school taxonomy, which was developed by John T. Dailey, is 
fully docimiented in an earlier report in this series (Flanagan et aZ., 1962, 
Chapter 4) . 
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of the sample. This taxonomy, which divided public high schools into 17 
categories, is described in Appendix G-1, Appendix G-2 shows the number of 
high schools in each category that were invited to participate in the retest 
study, and the number that accepted. 

Schools in the "basic retest sample" (by which term is meant all retested 
schools except those in the Battery V vocational group) were assigned one of 
the six basic retest batteries (A, B, C, D, E, or F) . Allocation of the 
retest batteries among the various schools was guided by the effort to have 
as many batteries as possible represented in each taxonomy category, and also 
to have the six batteries more or less equally represented in terms of number 
of schools and number of students. 



SIZE OF SAMPLE 

Number of Students and Schools 

Total Number in 1963 Testing . Table 2-1 shows the number of vocational 

and nonvocational high schools taking each retest battery. Appendix G-2 

shows the breakdown of these retest battery distributions by taxonomy group. 

Table 2-2^ shows the number of students, classified by retest battery and 

sex. It will be observed that three sets of numbers are presented in this 

table; they are designated, respectively "all cases", "matched cases", and 

"matched complete cases". The designation "all cases" means all students 

2 

tested in grade 12 in the 1963 retest study. This all-inclusive group con- 
tains as a subgroup the "matched cases" — i.e., those students tested in 1963 
for whom TALENT records are also available from the 1960 testing. The 



Table 2-2 contains a column showing the "administration category" of the in- 
cluded tests. This term is explained in a later section of this chapter. 

I 

A handful of these students — 48 boys (39 matched cases and 9 unmatched) and 
25 girls (16 matched and 9 unmatched) — reported they were below grade 12. 
(Some of these were probably clerical errors in marking the answer sheet.) 
For all practical purposes the retest sample may be regarded as consisting 
of grade 12 students. 
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’’matched complete cases” are those ’’matched cases” whose ’’retest classlflca** 
tion code” is 0, (This code is explained in Appendix C-5.) 



Number of Matched Cases . It will be observed from Table 2-2 that of the 
10,396 cases in the retest study for whom grade 12 TALENT data are available, 
7,678 (or approximately 75 percent of them) were also in the 1960 TALENT 
testing. The missing 25 percent probably consists mostly of students who were 
in entirely different schools in grade 9. By ’ ’entirely different school” is 
meant not merely a junior high school that normally feeds into the senior high 
school that was in the retest study, but a totally unrelated school. The 
fact that 25 percent of the grade 12 cases did not have matching grade 9 
records seems quite compatible with what we know about the mobility of the 
American population. Thus there is reason to believe that the record-matching 
procedure, which was carried out mostly as a computer operation, supplemented 
by clerical checks, was quite successful. In a later section of this chapter 
some of the details of the data-processing procedure will be described. 

Unmatched Cases . In a certain sense there are two kinds of **unnatched 
cases." The first consists of those students with 1963 data for whom no 1960 
record is available. These are the cases referred to as the ’’missing 25 
percent” in the previous paragraph, and probably most of them are students who 
transferred into the school sometime after the spring of 1960. Some of the 
’’missing 25 percent,” however, almost certainly are the result of anomalies 
in the computer-processing operation which prevented matching. The second 
kind of unmatched case consists of those students who were tested in grade 9 
in 1960, in one of the retested schools, but for whom there was apparently no 
1963 record. Some of the missing cases of this second kind were probably due 
to the same kind of computer-processing problems that we surmise may have 
been responslbi^e for some of the first kind of unmatched case. However it 
seems reasonable to suppose that most of the second kind of unmatched case 
are due to transferring to another high school, not in the retest study, and 
to dropout. There are substantially fewer of the first kind of unmatched 
case than of the second, and this is quite in line with expectation, because 
of the addition of the dropouts to the second group. 
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Cases Available for Each Combination of Tests 

Test Administration Categories . For convenience in dealing with the 
complexities created by the overlapping batteries, the tests were divided 
into subsets, each consisting of tests that were included in an Identical 
group of retest batteries. These subsets of tests are called "administration 
categories" in this report. There are eight of them, designated administra- 
tion categories 0, 1, 2, 3a, 3b, 4a, 4b, and 5.^ 

The composition of these eight categories (i.e., the tests included in 
them) is shown in Appendix C-3. Table 2-3 shows the number of students, 
separately by sex, in each of the eight categories. These counts show 
approximately how many cases are available for any test or inventory. 

Battery Overlap . A major purpose of building battery overlap into the 
design, as has already been indicated, was to make it possible to determine 
the correlation between any two tests. Table 2-4 shows the approximate num- 
ber of cases available for direct computation of the correlation between any 

two variables. In those few cases where direct computation is not possible, 

2 

indirect computation is . 

Table 2-4 is set up in terms of test administration category. In read- 
ing it, if one wishes to know how many cases are available for a correlation 
between R-311 (Arithmetic Reasoning) and R-250 (Reading Comprehension) , the 
first step is to refer back to Table 2-3 or to Appendix C-3, to ascertain 
what administration categories these two tests are in. It turns out that 



For certain purposes administration categories 3a and 3b are collapsed into 
a single category, category 3, and categories 4a and 4b are collapsed into 
category 4. 

2 

For instance if the correlation between R-lOO (Administration Category 5) 
and R-250 (Category 4a) were needed, it could be estimated from the following 
formula, (which utilizes the fact that R-lOO = R-190 + R-192) : 



r 




tc 




where a = R-190 
b = R-192 
t = R-lOO = a + b 
c = R-250 
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they are in categories 3a and 4a respectively. Turning again to Table 2-4, 
we see that there are 689 males and 693 females entered in the row-3a-column- 
4a cell. These are the approximate numbers of cases available for correlat- 
ing R-311 with R-250. 

Appendix C-4 consists of a table organized the same way as Table 2-4, 
but its cells contain retest batteries instead of numbers of cases . Appendix 
C-4 thus shows what batteries provide the numbers of cases that Table 2-4 
indicates are available. We can see, for instance, that Batteries F and V 
are the ones that provide the 689 males and 693 females for correlating 
R-311 with R-250. 

A comparison of the numbers of cases shown in Table 2-4 with the Table 
2-2 numbers for the appropriate batteries (as indicated in Appendix C-4) 
shows that the numbers of cases in Table 2-4 are generally a little lower 
than the corresponding counts of "matched cases" in Table 2-2 but higher 
than the counts of "matched complete cases." This is quite reasonable since 
Table 2-4 is limited to matched cases but not all the "matched cases" in 
Table 2-2 are complete on the variables involved in the correlation, and 
since, furthermore, some of the Table 2-4 cases available for the correlation 
do not qualify as "matched complete cases*" in view of the fact that they may 
lack scores on one or more variables not involved in the particular correla- 
tion. 

Table 2-5 shows the approximate number of cases available for each pair 
of variables, for use in correlations, when weighted data are to be used. The j 

counts shown in Table 2-5 are unweighted , and thus differ only slightly from I 

the Table 2-4 counts. The essential difference is that Table 2-4 includes I 

Battery V cases while Table 2-5 does not, since Weight Z for all Battery V 

cases is 0. (Weight Z is described briefly at the end of this chapter and in 
considerable detail in the next chapter.) 

DATA PROCESSING 

This section contains a condensed and somewhat simplified account of 
what was in actuality a very long, complex, and time-consuming series of 
operations, encompassing everything that lay between the administration of the 
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TABLE 2-4, Approximate number of matched cases available for 

correlations between any two variables in the study 



NOTE: In the following table, each grade 12 variable 

is represented by the 1963 "administration 
category" in which it falls. 



No. of matched cases 
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®Table 2-3 shows which tests administered in 1963 fall in each administration category. 



No cases are available on which to compute these correlations directly. However this 
is not a serious lack, since the only variables in administration category 5 axe two 
composites: #100 (information Toted) and #172 (Vocabulary Total). 



**_ 



The numbers of cases available for correlations involving certain SIB items may be 
considerably smaller than those shown here since not all students taking the SIB an- 
swered all items. 



-W-t/ A/ 

VIAA 



These N's are rounded and approximate, since there is considerable variation in N's 
among the 196O tests. 
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TABLE 2-5. 



Approximate number of matched cases with non-0 Weight 
available for correlations between any two variables in the study 



NOTE: In the following table, each grade 12 variable is represented by the 

1963 "administration category" in which it falls. 
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Gr.9 - 1960 

^Table 2-3 shows which tests administered in 1963 fall in each administration category. 



"'no cases are available on which to compute these correlations directly. However this 
is not a serious lack, since the only variables in administration category 5 are two 
onnmosites! //lOO (Information Total) and //172 (Vocabulary Total). 






The numbers of cases available for correlations involving certain SIB items may be 
considerably smaller than those shown here since not all students taking the SIB an- 
swered all items. 






These N*s are rounded and approximate, since there is considerable variation in N's 
among the 1960 tests. 
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retest batteries in 1963 and the completion of a set of tapes containing 
each student’s item responses and test scores in 1963 together with his com- 
plete 1960 TALENT record. 

Tape Preparation 

Putting the Raw Data on Tape . As part of the administration of the tests, 
each student was assigned a six-digit retest identification number, which was 
position-coded on all his answer sheets, along with his name. Sex and date of 
birth were also position-coded on one answer sheet, and father’s first name 
and mother’s maiden name on another. The answer sheets were put through an 
optical scaTiner, and all item responses and position-coded identifying infor- 
mation were put on tape . The fact that individual item responses were put 
on tape represented an important innovation, as far as Project TALENT was 
concerned, since this had not been feasible in the original TALENT testing. 

In 1960 the answer sheets containing most of the tests had been processed on 
a scoring machine, which put test scores on IBM cards, instead of item re- 
sponses on tape. 

Merging the Retest Tapes . Since each student used two, three, four, or 
five answer sheets (depending on which battery he took) the records for the 
various answer sheets had to be merged. This was done on an IBM-7070, match- 
ing on retest identification number and name. An effort was made to resolve 
minor discrepancies by a clerical operation which sometimes involved inspec- 
tion of the answer sheets. 

Merging the Retest Data with the 1960 Data . The merged retest records 
were matched with the tapes containing the 1960 TALENT data, and another 
merging operation was carried out, in much the same way, and with the same 
kinds of clerical checks, as the merging of several retest answer sheet 
records with each other. One major difference was that in merging the retest 
records with the original 1960 records, testing number was no longer available 
as a basis of matching, so that there was a heavier dependence on name match- 
ing, with all the problems that that entails. The initial computer 



^This phase of the data-processing was carried out by the Measurement Re- 
search Center, in Iowa City. 



operation for merging 1960 and 1963 data was based primarily on matching of 
name, date of birth, sex, and school. Secondary criteria were father’s first 
name and mother’s maiden name. In matching on the basis of schools, junior 
high schools that were feeder schools for a senior high school that was re- 
tested were treated as matching schools. After this initial matching 
operation, and clerical clean-up, additional computer searches for matching 
records were undertaken, in which the 1960 file was searched for students 
whose records matched except for school but who had been in a nearby school 
in 1960. This meant that any public, parochial, or private school in the 
same community as the retested school, or any school in a community adjacent 
to the one in which the retested school was located, was considered to be a 
’’matching school” for the purpose of locating 1960 records corresponding to 
1963 records. Through expedients of this sort and extensive clerical checks 
it was possible to match about three-quarters of the grade 12 retest records 
with corresponding 1960 TALENT records^. As has been indicated this percent- 
age is sufficiently high that it seems reasonable to suppose that 1960 TALENT 
records were found for almost all of the students tested in 1963 who had also 
been tested 3 years earlier. 

Scoring . All scoring of the 1963 data was done by computer. The IBM- 
7070 was used. Systematic spot-checking, done clerically, insured that 
reasonable standards of accuracy were being met. 

Subsequent Data-Processing Operations 

To facilitate data analysis, certain new variables and codes were added 
to the tapes. Chief among these were ’’Retest Weight Z” and the ’’Retest 
Classification Code.” 

Retest Weight Z . This is a weight for each student. It is applied in 
data-analysis operations when it seems desirable to make data from several 
batteries somewhat more comparable than they would be if differential weights 
were not applied. Weight Z is described in detail in Chapter 3, where its 

rationale is presented. 



^Throughout this report, the term ’’matched cases” is used in the interest of 
brevity, to indicate cases for whom both 1960 and 1963 records are available 
(though not necessarily complete for either year) . These ’’matched cases” 
are the ones whose classification code (described in Appendix C-5) is 0, 1, 
or 3. 
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Retest Classification Code . The function of this one-digit code is to 

facilitate selection of cases meeting certain specifications, for inclusion 

in a particular data-analysis operation. Appendix C-5 shows what the code is. 

It will be noted that classification codes 0, 1, and 3 represent "matched 

cases" while codes 2 and 4 represent unmatched cases. Code 0 represents the 

category called "matched complete cases," for which counts are shown in Table 

2 - 2 . 
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Chapter 3. TECHNICAL PROBLEMS 



1 



This chapter is concerned with certain technical problems and theoreti- 
cal considerations in the areas of measurement, data analysis, and interpre- 
tation of results. These are very broad, sweeping terms that may sound 
all-inclusive; but the scope of the chapter is considerably narrower, since 
it is concerned primarily with problems which are particularly relevant to 
this retest research because of either the design of the study or its general 
purpose. 

Technical problems that bear on only one sub-study within this general 
study are discussed in the chapter dealing with that sub-study. For instance 
Chapter 6, which is concerned in large part with the outcomes of a set of 
factor analyses, contains a discussion of factor analysis theory and method- 
ology. 

The three main topics of the present chapter are: 



2. Estimating individual correlation coefficients and obtaining 
comprehensive correlation matrices that are consistent and 
accurate, when a tremendous proportion of some of the raw 
data is missing. 

3. The measurement of change. 

Of these three topics, the first two arise as a direct consequence of 
the design of the study — or to be more specific, as a direct consequence of 
the organization of the tests into a large number of partially overlapping 
batteries, with different sets of schools taking different batteries. Al- 
though this expedient was undoubtedly necessary because of practical exigen- 
cies, inevitably it created technical problems in data analysis — and thus 



It is suggested that readers interested in the substantive results and not 
at all in methodological matters skip this chapter (and perhaps much of the 
next one as well). 



1. Problems in achieving comparability of data obtained from 
different retest batteries (and therefore from different 
groups of students) . 




i' 
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produced the need to solve these problems. The solutions are discussed in 
this chapter. 

The last of the three topics (i.e., the measurement of change) is dis~ 
cussed in the present chapter because it is directly relevant to the general 
purpose or central theme of the entire study, 

COMPARABILITY OF DATA FOR THE SIX RETEST BATTERIES 

The Problem 

In Chapter 2 is a description of how it was necessary to split the 
original TALENT battery into pieces, recombine the pieces in various ways to 
form six overlapping "retest batteries," A, B, C, D, E, and F, (seven if 
Battery V is included) and then to split the retest schools into groups, each 
to take a different retest battery. It is probably quite apparent that 
though a set-up as complex as this was necessary for many reasons, it brought 
with it some inherent difficulties. Perhaps the major problem lay in the fact 
that the groups taking the six retest batteries could not be chosen in such a 
way as to be directly comparable. 

A Solution! Differential Weights 

To help solve the p' oblem pointed out above, a system for weighting cases 
differentially was developed. What made it possible to develop these weights 
was the fact that the Abstract Reasoning Test had been Included in all bat- 
teries. The Abstract Reasoning Test is a measure of general mental ability, 
and as such, is correlated with many other tests in the battery. The correla- 
tions are moderate, undoubtedly being somewhat restricted as a result of the 
Abstract Reasoning Test’s brevity and consequent rather modest reliability. 
Nevertheless, despite the fact that the correlations are not high, they are 
high enough that it is reasonable to suppose that two groups that are alike 
in regard to Abstract Reasoning scores are more likely to be similar in 
regard to scores on other variables than are groups that differ substantially 
in Abstract Reasoning scores. 

The principle followed, accordingly, was to weight cases in such a way 
that within a sex, all six of the groups taking one of the six basic retest 
batteries (A, B, C, D, E, or F) would have identical percentage distributions 







on Abstract; Reasoning score (R-290) . The weight applied to each case to 
produce these results Is called Retest Weight Z. It is a furxtion of three 
things: the student’s sex, the student’s Abstract Reasoning score, and the 

retest battery. The percentage distributions for males or for females, after 
weighting, were not only to be Identical for all six basic batteries but they 
were also to be Identical to the percentage distribution for the six groups 
combined, unweighted . In order not to have the weights make any major change 
In the proportion of cases represented by any battery-and-sex combination, 
the Z weights for each such combination were scaled so that the total weighted 
number of cases would equal the original unweighted N. 

It was decided to apply the procedure only to the six basic retest bat- 
teries (A, B, C, D, E, and F) and to assign a weight of 0 to all Battery V 
cases.' The reason for this decision was that since the Battery V schools 
were all vocational high schools and all In New York City, any efforts to 
make them equivalent to more heterogeneous groups of schools, which Include 
both academic and vocational high schools, in all parts of the country, 
would be self-defeating. 

The procedure for determining Weight Z for each possible combination of 
retest battery, sex, and Abstract Reasoning score Is presented in Appendix 
H-1. Development of the weights was based on the entire group of approximately 
10,000 Battery A-F cases (not just the matched cases). 

Table 3-1 shows, separately for each sex, the distribution of Abstract 
Reasoning scores for each of the six basic batteries. All cases are Included. 
The distributions are unweighted. But when expressed In terms of proportion, 
the weighted distributions for each of the six batteries separately and for 
all batteries combined would of course be identical (except for rounding) to 
the Table 3-1 distributions for the six batteries combined. This is an 
automatic outcome of the way the weights were derived. 

Table 3-2 shows the corresponding distributions separately for each 
battery, but based on matched cases only. Both unweighted distributions and 
weighted distributions are presented In Table 3-2. A comparison of the 
unweighted and weighted distributions makes It apparent that the six battery 
groups are more similar when the weights are used than when they aren’t. 
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TABLE 3-2. Distribution of Abstract Reasoning scores (R-290), 
by sex^ based on matched cases 

(Based on grade 12 retest data, both unweighted and weighted) 



Percentage of cases 



R-290 






M 


ALE 


S 










F E 


M A L 


E S 








A 


B 


C 


D 


E 


F 


V 


A 


B 


C 


D 


E 


F 


V 












UNWEIGHTED 


Percentage Distribution 










15 


3.5 


3.1 


3.2 


2.1 


2.8 


2. A 


2. A 


2. A 


.5 


.9 


1.9 


1.5 


1.6 




lA 


6.9 


6.2 


6.3 


6.6 


7.1 


6.2 


2. A 


6.0 


5.5 


5.2 


5.8 


5.9 


3.7 




13 


12.7 


10.9 


10.8 


10.2 


12.0 


10.7 


10.7 


11.3 


9.1 


9.1 


8. A 


9.0 


9.7 


2.2 


12 


9.7 


15.3 


lA.A 


13.9 


16.6 


11.5 


7.1 


13.5 


11.8 


1A.8 


15.1 


1A.3 


13,2 


6.7 


11 


16.3 


13.9 


1A.5 


15.9 


15.7 


15.6 


20.2 


13.7 


15.9 


11. A 


1A.8 


16.7 


17.7 


10.0 


10 


13.2 


15.9 


1A.8 


17.3 


12.6 


12.8 


17.8 


1A.5 


13.3 


17. A 


1A.3 


12.5 


13.9 


12.2 


9 


11.7 


9.5 


10.6 


11.1 


11.2 


10. A 


16.7 


9.7 


10.7 


10.8 


lA.O 


12.0 


11.8 


6.7 


8 


8.7 


7.8 


8.2 


7.9 


6. A 


10. A 


10.7 


8.9 


10.7 


9.5 


9.8 


6.8 


9.0 


15.6 


7 


6.0 


5.9 


5.9 


5.5 


6.0 


7.7 


6.0 


6.3 


6. A 


6.6 


5.0 


7.3 


7.7 


21.1 


6 


3.2 


3.1 


3.5 


3.9 


3.2 


6.2 


1.2 


3.9 


3.9 


A.O 


3.5 


5.5 


3.9 


8.9 


5 


3.A 


2.9 


3.1 


1.8 


1.9 


2.6 


1.2 


2.9 


A. 9 


3.1 


2.6 


3.7 


3.2 


A. A 


A 


l.A 


2.1 


2 . A 


1.6 


2.1 


1.9 




3.5 


3.3 


2.5 


1.6 


1.6 


2.1 


6.7 


3 


1.9 


1.6 


1.2 


.9 


.6 


.6 


2. A 


1.5 


1.7 


2.2 


2.1 


.7 


1.3 


3.3 


2 


.9 


.7 


.3 


1.1 


..9 


.3 




1.1 


.9 


.8 


.3 


.9 


.6 


1.1 


1 




.9 


.1 






.2 




.5 


.6 


.5 


.6 


.5 




1.1 


0 


.5 


.2 


.7 


.2 


.9 


.5 


1.2 


.3 


.8 


1.2 


.2 


1.1 


.6 




Total 


100.0 


100.0 


100.0 


100.0 


100.0 


100.0 


100.0 


100.0 


100.0 


100.0 


100.0 


100.0 


100.0 


100.0 


Mean 


10.1 


10.1 


10.1 


10.2 


10.3 


9.9 


9.9 


9.9 


9.5 


9.6 


9.9 


9.8 


9.8 


7.9 


S.D. 


2.9 


2.9 


2.9 


2.7 


2.8 


2.8 


2.5 


3.0 


3.0 


3.0 


2.8 


3.0 


2.8 


2.6 


N 


565 


580 


7AA 


560 


535 


627 


8A 


620 


638 


768 


621 


5A6 


621 


90 




A 


B 


C 


D 


E 


F 




A 


B 


C 


D 


E 


F 





15 

lA 

13 

12 

11 

10 

9 

8 

7 

6 

5 

A 

3 

2 

1 

0 

Total 

Mean 

S.D. 

Weighted N 



2.7 

6.9 
11.1 
11.7 

16.5 
1A.6 

11.5 

8.9 

5.8 

2.9 

3.1 

1.6 

1.2 

.9 

.6 



3.1 

5.8 
11.5 
lA.O 
lA.A 
1A.5 
10.3 

7. A 

6.8 

A. A 

2.1 

2.3 

1.3 
.6 
.A 

1.1 



2.9 

5.8 
11.2 
13. A 
15.9 
lA.A 
11.0 

8.3 
6. A 
3.5 

2.9 
2.0 
1.2 

.5 

.1 

.5 



3.1 

6.7 
10.7 
1A.2 
1A.9 
1A.5 
11.3 

8.6 

5.5 

3.7 

2.6 

2.2 
1.0 

.7 

.3 



WEIGHTED Percentage 
2.6 2.8 
7.3 
11.2 
13. A 
1A.3 
lA.A 
9.6 

9.1 

6.1 
A. 7 
3.0 
1.9 

.7 
.A 
.7 
.A 



7.1 

11.1 

13.7 

15.7 
1A.3 
10.6 

7.3 
6.6 
A.O 

2.3 
1.6 
1.7 

.9 



.5 



100.0 100.0 100.0 100.0 100.0 100.0 



Distribution 

1.7 1.1 1.2 1.5 

5.6 5, A 5.6 5.2 

9.2 9.5 9.1 9.7 

13.8 12.1 1A.9 13.8 

1A.7 15. A 13.6 1A.3 

15.3 13.8 1A.7 15.2 

11.1 11.5 11.7 11.7 

9.2 10.1 9.0 9.0 

6.7 6.6 6.6 5.9 

3.7 A. 5 3.6 A. A 

3.6 3.7 3.1 3.1 

2.6 2.5 2.5 2.3 

1.3 1.7 2.2 1.5 

.7 .9 .9 .7 

.5 .A .5 .5 

.3 .8 .8 1.2 

100.0 100.0 100.0 100.0 



l.A 
A. 9 
10.0 
lA.A 
16.0 
13.3 
11.1 

9.2 
6. A 
A. 5 
3.6 

2.2 
1.0 

.8 

.5 

.7 



1.5 

5.3 

9.5 

13.6 
15.3 
1A.3 

11.6 
8.9 
6.8 
A.l 

3.3 

2.5 

2.0 

.6 

.7 



10.1 

2.8 


10.0 

3.0 


10.1 

2.8 


10.2 

2.8 


10.1 

2.9 


10.1 

2.9 


9.8 

2.8 


9.6 

2.9 


562 


58A 


7A7 


559 


533 


630 


620 


638 



9.7 

3.0 



9.7 

3.0 



100.0 100.0 

9.8 9.8 

2.9 2.9 



768 620 5A5 618 



!Er|c 



L 



CORRECTING CORRELATION COEFFICIENTS FOR MISSING DATA 



The Problem 

As is obvious from an inspection of Table 2-4 (and sections C-2 to 
C-4 of Appendix C) only about one-sixth of the students taking the 
basic retest batteries, A, B, C, D, E, and F, are available for direct in- 
clusion in the group when certain correlation coefficients are being computed. 
For instance in the case of certain pairs of tests, both tests were taken 
only by the Battery A group of students; for other pairs of tests, it was 
Battery B; for others. Battery C; etc. Thus not only is there necessarily a 
tremendous amount of missing data but there is zero overlap between the groups 
available for inclusion in certain correlation coefficients and the groups 
available for inclusion in others. For instance only 1,155 cases (542 boys 
and 613 girls, taking Battery B) have scores on both Mathematics Information 
(R-106) and Advanced High School Mathematics (R-333) . And for the correla- 
tion between the latter test and Visualization in Three Dimensions (R-282) 
an entirely different group consisting of 1,219 students (610 boys and 609 
girls taking Battery F) is available. Thus since there is nobody in the 
retest group who could be included in both these correlation coefficients, 
the three variables involved could not all be included in the same correla- 
tion matrix if the usually desirable restriction were imposed that only 
those cases for whom scores are available on all the variables in a matrix 
are to be included in it. This meant, of course, that since correlation 
matrices were needed to analyze the data adequately, it was necessary to 
abandon the restriction that only complete cases should be included. But 
in using correlation coefficients, as soon as one goes beyond the simple 
first step of regarding each correlation coefficient as a separate statistic, 
having nothing much to do with any other correlation coefficient, and tries to 
compare two, it is obviously imperative that the coefficients compared be 
based on the same group of cases or else on groups that can reasonably be 
regarded as equivalent . 

And when one moves beyond simple direct comparison of correlation co- 
efficients and begins to regard an entire matrix as a coherent set of data 
that may be treated as a unit in applying the procedures of mult*;Variate 
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analysis, the problems are multiplied. A correlation matrix not 
based on a single complete set of scores must be regarded with considerable 
suspicion. And when the extent of mlssilng data is as vast as in the case 
of the present study, researchers familiar with the pitfalls for the unwary 
in multivariate analysis could be expected to be vastly suspicious of multi- 
variate analysis performed on correlation matrices in which each coefficient 
is based on whatever cases are available for that pair of variables. Such 
matrices, in fact, might very well be termed pseudo-matrices — and in the 
interests of brevity that is exactly what we shall call them. 

Matrices are termed "inconsistent" if there is no possible set of real 
data that could have produced them. Quite apart from the obvious undesir- 
ability of using matrices (or any other kind of data, for that matter) that 
are so blatantly and basically Inaccurate, their use in multivariate analysis 
(and in certain univariate approaches as well) can lead to mathematical diffi- 
culties for which there is no logical solution. Thus it "is absolutely essen- 
tial that the basic matrix used in multivariate analysis be a consistent one. 

In addition to the requirement of consistency, it is also desirable, of 
course, that the matrix be as accurate as possible. Consistency is a necessary 
but not sufficient condition for accuracy. The appropriate procedure, there- 
fore, is first to try to get as accurate an estimate as one reasonably can of 
each correlation in the matrix, and only after this has been done, to test 
the matrix for consistency. Even with the precaution of obtaining the best 
estimates one can of each correlation, the matrix may still turn out to be 
slightly Inconsistent. (It seems extremely unlikely that with a good esti- 
mation procedure it would turn out to be grossly inconsistent.) In the event 
that the test of matrix consistency reveals any inconsistency, it should be 
possible with minimal modifications of the correlation coefficients composing 
it to convert it to a consistent matrix. 

The Solution; A Two-Part Approach 

To meet the needs outlined above, the author of this report has developed 
a mathematical procedure for modifying a pseudo-matrix to obtain a matrix 

^The technical name that mathematicians use for an Inconsistent matrix of this 
sort is "non-Gramian matrix." 
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which Is believed to be a closer approximation o£ what would have been obtained 
if the missing data had not been missing. 

In the previous section, where the nature of the problem was outlined, 
its twofold nature was pointed out. The first of the two aspects Is the need 
to obtain as good estimates as possible of the Individual correlation coeffi- 
cients. The second aspect, necessary only if an entire matrix is Involved, 
rather than a few scattered individual correlation coefficients, is to apply 
a test for consistency to the matrix resulting from the first stage, and If 
the matrix proves Inconsistent, to modify it slightly In order to make it con- 
sistent. Since the problem is twofold, so is the solution, the first part, 
of course, being to estimate the individual correlation coefficients and the 
second being to make the matrix consistent if it isn’t. 

When only a single correlation coefficient is of concern (as It might be 
if the problem were to validate a single test against a single criterion) , 
only the first part of the solution Is relevant. 

When the missing data occur In a multivariate score matrix, and the 
problem Is to obtain not just a single correlation coefficient but an entire 
correlation matrix, suitable for use in multiple correlation and in multi- 
variate procedures such as factor analysis, multiple discriminant analysis, 
and multivariate analysis of variance, the second part of the solution must 
be superimposed on the first. In order to Insure that the matrix will be 
consistent. It may be worth mentioning that In a few situations (which 
didn’t occur in the present study) the second part of the solution might be 
relevant and the first part inapplicable. An example of this could occur If 
an entire correlation matrix, based on complete cases only, were to be cor- 
rected for attenuation, since this might produce an inconsistent matrix from 
an originally consistent one. 

Thus there could be occasion to use either part of the solution indepen- 
dently of the other, and the method is readily applicable to such separate 
use. 

This report contains the first operational use of either part of the 
new procedure. Presentation of the derivation, which is a long and rather 
complex one, is not feasible here. Since it will be documented in detail 
elsewhere, only the barest description of the procedure, together with a 
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fairly full statement of the assumptions underlying It, will be presented at 
this point. 

Stage 1. Correcting the Individual Correlation Coefficients 

The first stage of the procedure for correcting any individual cor- 
relation coefficient consists in obtaining an ordinary Pearson product- 
moment correlation coefficient for all available observations. The procedure 
for modifying this coefficient to correct for missing data involves the use of 
all cases having data for either or both of the variables to be correlated. 

The assumptions that are Inherent in the derivation and underlie the 
procedure are: 

1. That the relation between the two variables is essentially 
linear. 

2. That the standard error of estimate is uniform throughout 
the range (l.e., that the complete bivariate distribution is 
homoscedastlc) . 

3. That cases with a missing score on one of the two variables 
are a random sample of the corresponding array of scores on 
the other variable. 

It should be understood that nowhere in the derivation, either explicitly 
or implicitly, are any of the following common assumptions made: 

1. That the cases for whom scores are available on both variables 
are a random sample of the total group. 

2. That for either one of the variables the cases for whom scores 
are available are a random sample of the total group. 

3. That the hypothetical bivariate distribution for the total 
group is normal. 

4. That the actual bivariate distribution for the cases having 
scores on both variables is normal. 

5. That the distribution of either of the individual variables 

is normal, either for all cases having a score on the variable 
or for the cases having scores on both variables. 



6. That the distribution is truncated on either variable. (In 
other words it is not necessary that the cases with missing 
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scores on one variable constitute a block at one or the 
other end of the distribution on the other variable.) 

7. That the cases with mlss^ig scores constitute a block of ad- 
jacent cases on either variable. 

Stage 2. Insuring Matrix Consistency 

The test for consistency Is tc check whether the matrix Is free of 
negative eigenvalues. If the matrix turns out to be Inconsistent the pro- 
cedure for converting It to a consistent one Is applicable primarily when the 
Inconsistency Is only slight — In other words when only comparatively few of 
the eigenvalues are negative and those few not numerically large. 

If the matrix were grossly Inconsistent, the procedure would be Inap- 
plicable because the assumption that departures from consistency were due 
primarily to sampling errors would then presumably become untenable. 

The second-stage solution consists In algebraic manipulation of the 
matrix In such a way that the few negative eigenvalues are changed to 0 
(thus producing a singular matrix) with minimal changes In the other eigen- 
values and the correlations constituting the matrix. The singularity of the 
resulting consistent matrix Is not a disadvantage since presumably only a 
matrix very close to singularity would be likely to be pushed over to the 
"Inconsistent" side of the dividing line between consistent and Inconsistent 
matrices, as a result of missing data. 

THE MEASUREMENT OF CHANGE 

A knotty technical Issue, one In which many educational researchers have 
become entangled. Is the deceptively simple-sounding problem of how to 
measure change . 

Raw Differences vs. Adjusted Differences 

It has become an article of faith among many researchers that It Is 
technically unsound, when Investigating growth or any other kind of change 
occurring between one time and another, to pay much attention to raw differ- 
ences between measures obtained on the two occasions. Statistically knowl- 
edgeable researchers have pointed out, quite properly, that raw differences 
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are sometimes and for some purposes misleading, since gains in score between 
the initial and final testing tend to be negatively correlated with initial 
score. Another contingent of researchers has not only accepted the view de- 
scribed above, but has accepted it uncritically, in somewhat distorted form. 
Therefore misconceptions on the topic are widespread. 

Because the study of growth and change is the central theme of the re- 
search reported in this study it seems advisable to make clear at the out- 
set the viewpoint on measurement of differences and of change that 
has guided this research. It would be presumptuous to imply that in a few 
brief paragraphs it is possible to summarize the solution to all aspects of 
this problem. It isn’t. Whole books have been written on the problem — and 
they have helped materially to shed light on it. For instance there is 
Thorndike’s excellent study on The Concepts of Over- and Underaohievement 
(Thorndike, 1963). The volume edited by Harris on Problems in Measuring 
Change^ which presents papers on many different aspects of the problem, in- 
vestigated from many different viewpoints (and resulting, in some cases, in 
apparently conflicting conclusions) , is another very helpful volume even 
though the differences of opinion it embodies preclude its providing any one 
definitive answer. Davis, in his textbook Educational Measurements and 
Their Interpretation (Davis, 1964, Chapter 10), provides some fresh insights 
and some useful formulas that are not very well known. 

The problem has too many ramifications for any single simple statement 
to summarize the solution to all aspects and all variants of the issue. 
Nevertheless, since the problems in the present study are relatively simple 
ones, not involving all aspects and all variants of the issue, an effort to 
describe briefly the single viewpoint that has resulted in the multiple 
methodological approaches used in this study seems worth undertaking. 

Let us start by reiterating that the notion that raw differences are 
sometimes misleading is perfectly correct. There a tendency towards neg- 
ative correlation between gains and initial score. As a matter of fact un- 
less the variance of the scores is considerably greater on the second occasion 
than the first, the correlation between initial score and gain will neces- 
sarily be negative when the correlation between initial and final score is 
positive but not perfect — the usual situation of course. But even with the 
normally expected positive correlation between initial and final score, neg- 
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ative correlation between initial score and gain is not inevitable. A large 
increase in standard deviation can counteract the pull towards the negative 
side of the correlation scale. 

All this can be seen from the formula for the correlation between initial 
score and gain: 



^AB^B ”^A 



AG Og 

where A = initial raw score 
B = final raw score 
G = gain = B - A 

When and are equal, the formula reduces to: 



( 1 ) 



( 2 ) 



AG 






- r 



AB 



which is necessarily negative, of course. 

Another rather widespread misconception is that the tendency of gains 
to be negatively correlated with initial measure is caused by failure of the 
measures used to be perfectly reliable. A look at formula 1 above makes it 
clear that this is not the case, since reliability coefficients do not even 
enter into the formula, when the same initial measure that was used in com- 
puting gains is used in the correlation between gains and initial score. 
Where two parallel initial measures are available one can be used in com- 
puting gains and the other as the variable to be correlated with gains, thus 
"correcting for unreliability," in which case the relevant formula becomes: 



^AB^B " ^AA^A 



A*G 



(3) 



It is clear that even this correction would not often change a negative 
correlation between initial score and gain to a positive one if the standard 
deviations of the initial and final measures were about equal, since in the 
usual situation r^ would be considerably lower than the reliability 
of the initial score. 

Furthermore, and quite apart from the problem of test reliability or un- 
reliability, none of the foregoing discussion implies that if, for instance, 
students in schools that score low in grade 9 were to show larger gains by 
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grade 12 than students in schools where the grade 9 scores are fairly high, 
this finding should be regarded as a trivial one, that is caused merely by 
the workings of correlation and of formula 1 or 3. The habit of interpret- 
ing results of this sort as if the correlation coefficient existed before 
the scores and caused them to behave in accordance with it rather than merely 
describing the way they behave is more prevalent than it should be. Along 
with this goes the habit of explaining away possibly important results as 
being "caused by regression," as if regression were some sort of demonic 
causative agency operating in a goal-directed way, to make negative correla- 
tions sprout where positive ones might otherwise be expected. 

"Regression" is merely a description of the phenomenon — a description 
that helps explain it. In no sense is it a cause of the phenomenon. 

In this report, therefore, both approaches will be used. Raw gains will 
be investigated in seeking the answers to certain questions and gains "cor- 
rected for regression" — in other words residual gains ^af ter subtraction of 
the amount of gain that would be predicted on the basis of initial score — 
will be used where this approach is the appropriate one. 

Perhaps all this can be summarized by saying there is no single best 
procedure because there is hot just a single kind of question to be answered. 
In this research we shall attempt to have the questions that are to be an- 
swered serve as determining factors in choosing the methodology to be used. 

Obtaining Adjusted Measures 

I Granted that there are questions about growth or change that can best be 

I answered if a partial correlation or covariance analysis procedure is used in 

I which the data are adjusted for initial score, the question is how. More spe- 

i cifically, should the raw gains themselves (i.e., the raw differences between 

■'1 ' . ■ ' ■ 

I initial and final score) be corrected for covariance with the initial score, 

i or should it be the final score that receives this treatment? In other words 

what variable should be studied — final score (after adjustment) or gains 
j (after the same kind of adjustment)? 

The answer to this question is that it doesn’t make the slightest differ- 

i 

] ence — because they are identical. In fact this equivalence can be generalized 

t even further. Residual gain and residual final score are equal even when 
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more than one variable is used as a covariate. It doesn’t matter how many 

covariates there are> for this equivalence still to apply, as long as the 
same set is used for the residual final scores and the residual gains scores, 
and as long as one of the covariates is the initial score on the variable 
under consideration. This is an important consideration in the case of the 
present study since in studying gains corrected for initial status, it seems 
advisable to define initial status not merely as grade 9 score on the variable 
in question but as a complex consisting not only of that score but also of 
grade 9 scores on a large number of other variables that might have a signif- 
icant effect on growth. 

Throughout this report the type of analysis referred to above is some- 
times referred to as analysis of gains corrected for covariance (or analysis 
of residual gains) and sometimes as analysis of final scores corrected for 
covariance (or analysis of residual final scores) . The reader is asked to 
bear in mind that they mean the same thing. 

What Kind of Instruments to Measure Change ? 

We have been concerned with the problem of how to compute differences in 
measuring change. A somewhat different though related problem is how to set . 
up the score scales used to determine initial and final score. Is it possible 
to do it in such a way that the units are "equal" at all parts of the scale? 
And even more basically, can we be sure the psychometric instrument Is measur- 
ing the same function at all levels? Thorndike has summarized both these 
problems cogently in a recent paper: 

"...change scores are very sensitive creatures, very responsive to 
changes in score scale and to changes in the function being measured. 

So perhaps we need to modify the earlier conclusion ... that only a 
small fraction of the gain in later competence can be thought of as 
arising from a continuation of early growth trends. Perhaps it must 
be concluded that, unless and until scales are developed that are 
truly homogeneous in the functions that they tap at all levels and 
are truly expressed in equal units, we will have to forego serious 
attempts to give a quantitative answer to the simple but tantaliz- 
ing question: To what extent will the children who have grown rapid- 

ly in intellect up to the present moment continue to grow rapidly in 
the future?" (Thorndike, 1966, p. 127) 

^The proof is presented in Appendix H-2. 



The problems he points out haven’t been completely solved in Project 
TALENT — or, for that matter, anyplace else, so far as we know. We certain- 
ly are in no position to assert, and defend the assertion, that our scales 
measure "equal units" throughout. Nor can we assert a yviovi that the same 
fundamental skills are involved at all levels in our test scales. As a 
matter of fact, we can be reasonably sure they aren't. It is perhaps one 
of the basic attributes of growth in mental abilities (and other kinds of 
abilities too) that it involves changes in approach, the utilization of new 
approaches, or the bringing of old, well-established skills to bear on a task 
to which they had not previously been applied. Certainly the adult who reads 
competently does not do it in precisely the same way as the 6-year-old who 
is just learning to read. It is not a case of the adult performing just like 
the 6-year-old, only more so. Likewise the person who happens to have learned 
that the square of 14 is 196 and is reasonably skilled in arithmetic can 
determine the square of 1.4 almost instantly without going through the labori- 
ous process of multiplying by 4, multiplying by 1, offsetting the second 
product properly, adding them, counting the decimal places in multiplier and 
multiplicand, adding them, and marking off the proper number of decimal places 
in the final product. 

Fortunately, however, this problem is not a basic one as far as our study 
is concerned. The tests in the TALENT battery are more concerned with func- 
tional skills and knowledge that the student has acquired than with the "atoms" 
that unite to form them. We are concerned with such questions as: "How well 

does the student read? How good is he at math? How much does he know about 
science? About social studies?" We are far more interested, in the present 
study, in investigating questions about how well the student reads than 
questions about how he reads. What we want to know is how well the student 
comprehends what he reads and how fast he can read with comprehension, not 
how many eye movements he makes. When we delimit our problem thus, the ques- 
tion of homogeneous functions throughout the scale diminishes in importance. 

(In Chapter 6 we do take some first steps to investigate it, however. In that 
chapter we present factor analyses based on grade 9 scores and grade 12 
scores on the same tests. This permits us to get some idea of whether and 
how the factorial composition of performance on these tests changes in the 3- 
year interval.) 
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As for the related problenn of "equal units" at all parts of the scale, 
it remains a problem! And it is a matter that affects the reliability of 
measures of change. Difference scores are notoriously unreliable, particu- 
larly when the difference between correlated variables is involved— as it 
almost always must be if the study of change is to be meaningful. But as we 
shall see in Chapter 4, even though we have not rescaled the test scores in 
an effort to make the units "equal," the raw score differences do, for the 
most part, tend to have a degree of reliability adequate for research use. 
And this is especially true in the case of the longer scales such as those 
measuring reading and matheinatics skills. 
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Chapter 4. NEW FINDINGS ABOUT THE BATTERY 



This chapter is concerned more directly with the TALENT battery itself, 
both in its original version and as administered in 1963 for the retest study, 
than with inferences about the students who took it or the schools where it 
was taken. The purpose of this concern is twofold: first, to provide data 

that will be of use in interpreting the findings about the retested students 
and schools presented in Part XII of this report (Chapters 5 - 8) ; and 
second, to provide data that will be useful in planning, carrying out, and 
interpreting research to be done in the future that uses as a base the main 
TALENT sample, tested in 1960. 

DEGREE OF SPEEDEDNESS OF THE TESTS 



In administering any large test battery on a large-scale basis it is 
virtually a necessity to have specific time limits, even for tests that are 
essentially unspeeded. In such cases the time limits ideally would be gen- 
erous enough to permit everyone to finish or at least to have time to try all 
the items that he was capable of answering correctly. Most of the tests in 
the battery were intended to function this way. The only explicit exceptions 
were two tests that were intended to be partially speeded, in other words to 
permit those students to finish who had a very good mastery of the ability 
being tested, and four tests that were deliberately designed to be so highly 
speeded that nobody would be able to finish. The two partially speeded tests 
are Disguised Words (Scale 220) and Visualization in Two Dimensions (Scale 
281) . The four fully speeded tests are Arithmetic Computation (Scale 410) , 
Table Reading (Scale 420), Clerical Checking (Scale 430) , and Object Inspec- 
tion (Scale 440) . 

Tables 4-1 through 4-5 give some idea of the extent to which the stu- 
dents were able to finish the various "unspeeded" and "partially speeded" 
tests. The first three of these tables provide data on the Interest Inven- 
tory and on all of the tests except the four fully speeded ones (Scales 410, 
420, 430, and 440). Tables 4-4 and 4-5 provide supplementary information on 
the information and interest scales. 
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4 C 



Unweighted N*s are about equal to weighted N*s. 



Table 4-1 shows the mean and standard deviation of both the number and 
proportion of items completed on each test. The percentages of students 
completing the test are also shown. The distributions on which these data , 
are based were weighted by Retest Weight Z in order to make the results as 
comparable as, possible for tests in different combinations of retest bat- 
teries. Tables 4-2 and 4-3 are based on the same distributions, weighted in 
the same way, as Table 4-1. Table 4-2 shows selected percentile points on 
the distribution of number of items completed (i.e., the L score^) for 14 
variables. Separate percentiles are shown for each sex. Table 4-3 shows 
essentially the same data as Table 4-2, but with the L-scores (which repre- 
sent number of items completed) converted to proportion of items completed. 
Table 4-4 shows the percentage of students completing each scale of the 
Information Test and the Interest Inventory. 

As has been indicated, only two of the tests (Scales 220 and 281) in- 
cluded in Tables 4-1 through 4-3 were definitely intended to function as 
partially speeded tests. It is clear from the first three tables that on 
almost all the other tests — the ones that were intended to be essentially 
unspeeded — most of the students had time to finish or nearly finish. The 
principal exceptions were Information Part II and to a lesser extent Memory 
for Words. There were a sizable number of students who didn’t finish the 
Mathematics Test, but it is clear from Table 4-1 that this was due almost 
entirely to not finishing Math III, Advanced High School Mathematics. Since 
the Math III test was designed for that segment of the student body that had 
had college-preparatory mathematics courses beyond grade 9, it seems likely 
that the apparent failure to finish this test was due in most cases to delib- 
erate omission of the items. 

The reason sizable groups of students fail to complete Information Part 

2 

II and Memory for Words is not quite clear, particularly in the case of In- 
formation II, which was finished by a larger percentage of the national sample 



See Appendix A. 

The Memory for Words Test was designed to be parallel to the Paired Asso- 
ciates Test of J. B. Carroll’s Psi-Lcanbda Foreign Language Aptitude Battery 
(by arrangement with the author) . Accordingly it was made identical in 
length and used the same time limits. 




TABLE A-2. L-scores (last item completed) corresponding to selected percentiles ^ 
Based on grade 12 students (matched cases, weighted by Retest Weight Z) 



Number of items completed 



** 

Percentile 


L- 

190 


L- 

192 


7^- 

212 


L- 

220 


L- 

230 


L- 

240 


L- 

250 


L- 

260 


L- 

270 


L- 

281 


L- 

282 


L- 

290 


L- 

340 


L- 

700 


Info. 

I 


Info. 

II 


Mem. 

for 

Wds. 


Disg. 

Wds. 


Eng. 


Wd. 

Funct. 


Rdg. 
Comp . 


Great. 


Mech. 

Reas. 


Vis. 

2 

Dim. 


Vis. 

3 

Dim. 


Abst. 

Reas. 


Math 


Int. 

Inv. 














M A 


L E S 
















i 60 

: 50 

40 
30 




137.8 




27.6 

25.1 
22.5 

20.1 












22.7 
21.1 

19.8 
18.3 










25 

20 

15 

10 


• 


132.1 

125.4 
118.0 

108.4 


23.3 

21.8 

19.9 


18.9 

17.7 

16.4 

14.4 






43.1' 


19.9 


19.2 


17.3 

16.4 

15.4 
14.2 






53.0 

51.6 


190.5 


'■ 

5 

4 

3 

2 

1 


244.5 

236.5 
230.3 
221.0 

205.5 


96.1 

91.8 

90.0 

83.0 
71.5 


16.5 

14.6 

12.7 
9.0 

.7 


11.5 

10.6 
7.5 

.9 

.5 


112.7 

111.0 

97.6 

80.7 


21.3 

19.8 

18.0 

14.0 

2.5 


36.2 

34.0 
32.5 
29.7 

25.0 


17.0 

16.0 

15.2 

13.6 

10.5 


17.2 

16.7 
16.0 
15.0 

12.7 


12.2 

11.6 

11.2 

10.0 

8.0 


15.0 

14.2 

13.3 

12.4 
9.5 


14.2 

.8 


46.8 

44.0 

40.2 

37.2 
16.5 


171.3 

162.5 

158.5 

144.5 

122.6 


Mean 

S.D. 


250.2 

10.1 


134.2 

16.8 


22.7 

3.8 


23.5 

7.1 


112.0 

8.1 


23.4 

3.1 


46.4 

5.6 


19.6 

2.0 


19.6 

1.8 


20.1 

4.4 


15.7 

1.6 


14.8 

1.7 


52.6 

6.2 


200.6 

15.3 



FEMALES 



80 

75 




















23.2 

22.1 










70 

60 

50 

40 

30 








27.6 

25.3 

23.3 
21.2 












21.3 

19.7 
18.2 

16.7 

15.4 










25 

20 

15 

10 




143.0 

134.3 

126.3 
116.5 


21.9 


19.8 

18.6 

17.2 

15.5 






43.7 


19.8 


18.7 

17.6 


14 . 7 

13.9 

12.8 

11.9 






52.7 

50.8 




5 

4 

3 

2 

1 


251.7 

247.0 

229.5 


104.8 

102.6 

100.3 

94.5 

86.0 


18.4 
16.8 

14.5 
10.7 

.8 


12.1 

11.4 

8.5 

.8 

.4 


112.4 


23.3 

21.6 

19.0 


41.0 

37.3 

35.5 

32.3 

26.5 


18.4 
17.9 
16.8 
15.2 

10.5 


16.2 

15.8 

15.2 

14.1 

12.0 


10.3 

9.9 

9.4 

8.7 

7.3 


15.6 

14.7 
14.0 
12.6 
11.2 


15.0 

14.0 
1.0 


47.4 

46.3 

43.3 
40.2 

29.5 


198.5 

191.5 
182.7 

171.5 

143.5 


Mean 

S.D. 


251.4 

5.1 


137.0 

13.5 


23.1 

3.5 


23.9 

6.8 


112.3 

7.7 


23.7 

2.2 


46.7 

4.9 


19.7 

1.9 


19.4 

2.0 


18.0 

4.7 


15.8 

1.6 


14.8 

1.6 


52.8 

4.8 


203.2 

9.8 



Based on the same distributions as Table 4-1. The numbers of cases on which these data are based are shown in Table 4-1 






Percentage of students not. completing the indicated number of items. 
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TABLE 4-3. Proportion of items completed, corresponding to selected percentiles 

Based on grade 1*. students (matched cases, weighted by Retest Weight Z)* 



190 192 

Percentile Info. Ii.fo. 

I II 



Proportion 



212 


220 


230 


240 


Mem. 

for 

Wds. 


Disg. 
Wds . 


Eng. 


Wd. 

Funct . 



: items 


completed 






250 


260 


2 70 


281 


Rdg. 


Great . 


Mech. 


Vis. 


Comp. 




Reas. 


2 

Dim. 



282 


290 


340 


700 


Vis. 


Abst . 


Math 


Int 


3 

Dim. 


Reas . 




Inv 



MALES 



60 

50 

40 

30 



.920 

.837 

.750 

.964 .670 



.946 

.880 

.826 

.763 



25 

20 

15 

10 

5 

4 

3 

2 

1 

Mean 

S.D. 





.924 

.877 

.825 

.758 


.971 

.908 

.829 


.630 

.590 

.547 

.480 






.898 


.995 


.960 


.721 

.684 

.642 

.592 






.982 

.956 


.929 


.970 

.938 

.914 

.877 

.815 


.672 

.642 

.629 

.580 

.500 


.688 

.608 

.529 

.375 

.029 


.383 

.353 

,250 

.030 

.017 


.997 

.982 

.864 

.714 


.888 

.825 

.750 

.583 

.104 


.754 

.708 

.677 

.619 

.521 


.850 

.800 

.760 

.680 

.525 


.860 

.835 

.800 

.750 

.635 


.509 

.484 

.467 

.417 

.334 


.938 

.888 

.831 

.775 

.594 


.947 

.053 


.867 

.815 

.745 

.689 

.306 


.836 

.793 

.773 

.705 

.598 


.993 

.040 


.938 

.117 


.948 

.158 


.783 

.237 


.991 

.072 


.976 

.129 


.966 

.117 


.979 

.100 


.980 

.090 


.838 

.183 


.984 

.100 


.987 

.113 


.974 

.115 


.978 

.075 



FEMALES 



80 

75 




















.967 

.922 










70 

60 

50 

40 

30 


' 






.920 

.843 

.777 

.707 












.888 

.821 

.759 

.696 

.642 










25 

20 

15 

10 




1.000 

.939 

.883 

.814 


913 


.660 

.620 

.573 

.517 






.910 


.990 


.935 

.880 


.613 

.580 

.534 

.496 






.976 

.941 




5 

4 

3 

2 

1 


.999 

.981 

.911 


.733 

.717 

.701 

.661 

.601 


767 

701 

605 

446 

033 


.403 

.380 

.283 

.027 

.013 


.995 

.788 


.972 

.901 

.792 

.605 


.854 

.777 

.739 

.673 

.552 


.920 

.895 

,840 

.760 

.525 


.810 

.790 

.760 

.705 

.600 


,430 

.413 

.392 

.263 

.304 


.975 

.919 

.875 

.788 

.700 


1.000 

.933 

.067 


.878 

.857 

.802 

.745 

.546 


.968 

.934 

.891 

.837 

.700 


Mean 

S.D. 


.998 

i020 


.958 

.094 


963 

146 


.796 

.227 


.994 

.068 


.988 

.092 


.973 

.102 


.983 

.095 


.969 

.100 


.751 

.196 


.986 

.100 


.988 

.107 


.978 

.089 


.991 

.048 


it 

Based on the 
Table 4-1. ' 


same distributions 


as 


Tables 


4-1 and 4-2. 


The 


numbers 


of cases 


on which 


these 


data are 


based 


are shown 


in 



Percentage of students r^t completing the indicated proportion of the items. 
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TABLE 4-4, Percentage of students completing each scale of Information Test and Interest Inventory 
Based on grade 12 students (matched cases, weighted by Weight Z)* 




J 

I 

. 4-7 - 



of grade 12 students tested in 1960 (Flanagan et dt,^ 1964, Tables 2-3 and 

s 

2-4) . Because of the unexpectedly larger percentage of students in 1963 
that didn’t reach the end of this test, the mean number of items completed 
on each subscale was determined. The resultr are shown in Table 4-5. It is 
clear from this table that the average amount completed was well over 90 
percent of the items, in the case of most of the Information II subscales. 

And in the case of some of the subscales, notably Vocabulary II, the mean 
was very close to 100 percent of the items. 

On the tests included in Tables 4-1 through 4-3 other than the four ex- 
ceptions mentioned above (Disguised Words, Visualization in Two Dimensions, 
Memory for Words, and Information Part II), almost all the students finished 
—or If they didn’t it was because they chose not to, and not because they 
didn’t have time. Furthermore on many of the tests the items had been ar- 
ranged systematically in order of difficulty (from easiest to hardest) so 
that even the very few students who didn’t finish were likely to have reached 
all the items they would have been able to answer. Thus even in the rare 
cases when the last item the student answered was nowhere near the end of the 
test it seems likely that it was not because he didn’t have time to finish but 
rather because he chose not to attempt the more difficult items. 

The extremely high percentage of students finishing the test and the 
fact that on most tests virtually all of them came very close to finishing is 
important for another reason; it means we can get sound estimates of reli- 
ability of these tests by using the split-half procedure. 

Researchers who would like to be able to draw some conclusions about the 
adequacy of the time limits, not merely for the retest sample but for the main 
Project TALENT sample as well, will probably want to know how much alike the 
main sample of grade 12 students and the retest sample are. The answer is 
that they are very similar indeed. In Table 4-9, we see that the grade 12 
mean for boys is 32.93 and for girls it is 34.13, on the Reading Comprehen- 
sion Test. These values are not far from the means shown in the norms table 
in an earlier Project TALENT report. The American HighSchool Student y 
(Flanagan et at,, 1964, Table 3-2, Part 52, p. 3-52). Those means, based on 
the same cases as the Project TALENT percentile norms for the national 
sample, are 33.02 for grade 12 boys and 33.56 for grade 12 girls. The 
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TABLE 4-5. Average number and proportion of items reached 
■’‘n each scale of Information Test, Part II 

Based on grade 12 students (matched cases, weighted by Weight Z) 



Information 




Average number 


Average proportion 


Scale 


n* 


of items reached 


of items reached 






M F 


M F 



131 


Art 


12 


11.2 


11.5 


.937 


.958 


132 


Law 


9 


8.4 


8.6 


.938 


.957 


133 


Health 


9 


8.6 


8.7 


.956 


.971 


134 


Engineering 


6 


5.5 


5.6 


.910 


.938 


135 


Architecture 


6 


5.8 


5.8 


.958 


.973 


136 


Journalism 


3 


2.9 


2.9 


.960 


.977 


137 


Foreign travel 


5 


4.8 


4.9 


.966 


.978 


138 


Military 


7 


6.5 


6.6 


.927 


.950 


139 


Acct., busin., sales 


10 


9.4 


9.6 


.943 


.961 


140 


Practical knowledge 


4 


3.7 


3.8 


.930 


.952 


141 


Clerical 


3 


2.6 


2.7 


.863 


.907 


142 


Bible 


15 


14.2 


14.5 


.949 


.966 


143 


Colors 


3 


2.9 


3.0 


.977 


.987 


144 


Etiquette 


2 


1.8 


1.8 


.895 


.925 


145 


Hunting 


5 


4.8 


4.9 


.970 


.982 


146 


Fishing 


5 


4.7 


4.8 


.936 


.956 


147 


Outdoor activ. (other) 


9 


8.4 


8.6 


.929 


.951 


148 


Photography 


3 


2.8 


2.9 


.940 


.957 


149 


Games (sedentary) 


5 


4.6 


4.7 


.920 


.944 


150 


Theater, ballet 


8 


7.3 


7.5 


.909 


.937 


151 


Foods 


4 


3.8 


3.8 


.938 


.958 


152 


Miscellaneous 


10 


9.3 


9.5 


.929 


.953 


192 


Information II Total 


143 


134.2 


137.0 


.938 


.958 


162 


Vocabulary II 


9 


8.8 


8.9 


.981 


.991 



n = number of items in test. 






Based on the same cases as Table 4-4. 
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standard deviations are also quite similar for the two groups. The results 
are sxmilar for other tests as well, but Reading Comprehension has been 
singled out for explicit discussion here because students who read poorly 
are among those most likely to have trouble getting to the end of a test. 

Thus it would appear that the retest data on adequacy of time limits 
are quite generalizable to the main Project TALENT sample. It must be borne 
in mind, of course, that these data are directly applicable only to grade 12 
students. The situation could conceivably be a little different in the lower 
grades . 

RELIABILITY OF THE TESTS ^ 



Importance of the Problem 

Need for Accurate Reliability Estimates . In a study such as the present 
one, where the findings depend largely on correlational relationships and 
complex analyses of the interrelations among the correlations, it is impera- 
tive that the reliability coefficients corresponding to the data be borne in 
mind. Where we are trying to find out something about the nature and pattern 
of growth of abilities, for instance, and find that the correlation between 
the grade 9 score and the grade 12 score on a particular test is low, is it 
because the underlying ability that the test is intended to measure is one 
that basically has little stability over the 3-year interval between grades 9 
and 12 or is it merely because the test has poor reliability in one or both 
of the grades tested? 

For most of the Project TALENT tests, the retest study provided the 
first opportunity to get sound reliability estimates based on a Project 
TALENT sample. Previously, for many of the tests, the only way reliability 
could be estimated was by the KR— 21 formula, since only total scores were 
available, not half-test scores or responses to individual items, so that 
better procedures such as split-half or even KR-20 could not be used. (The 

^Readers interested in substantive results and not at all in methodological 
matters should probably skip most of this section. However they might find 
it helpful to examine the reliability coefficients in Table 4-8 (and 
possibly those in columns 5 and 6 of Table 4-7 as well) . General familiarity 
with these reliability coefficients will prove helpful in interpreting 
properly the substantive data presented in subsequent chapters. 



KR-20 formula in the present context is regarded as somewhat inferior to 
split-half, since the assumptions it requires are more numerous and usually 
less plausible than the split-half assumptions, but it is greatly superior to 
KR-21, which tends to underestimate the reliability of unspeeded tests sys- 
tematically and in some cases grossly.^) The reason reliability estimation 
procedures that couldn’t be used on data from the original 1960 TALENT test- 
ing were possible for the retest data was that by 1963 better equipment for 
reading and processing the answer sheets had become available. The electronic 
scoring machine that determined raw scores and punched them into cards had 
been replaced by an optical scanner that put each item response on tape. In 
The Amerioan EighSohooZ Student (Flanagan et al,^ 1964, Chapter 2) consider- 
able attention was devoted to the problem of getting estimates of reliability 
by a collection of somewhat makeshift procedures, because for most of the 
tests the kind of data needed for use of a really satisfactory procedure was 
not available. Now it — at least for grade 12. 

It was possible to take advantage of the availability of the item 
response data, not only to get good estimates of reliability for the grade 
12 retest data but also, by means of the correction-for-range formula, to 
estimate what the reliability coefficients obtained by these better methods 
would have been on the ’’norms group” used as the basis for most of the re- 
search reported on in The Amevtoan Eigh-Sohoot Student (Flanagan et al,y 1964). 
The possibility of doing this is a real advantage, in view of the fact that 
where reliability coefficients are being used it is essential that they be 
appropriate for the group,. This is particularly true when they are being used 
in conjunction with other correlation coefficients, as in correction for at- 
tenuation or in estimating the reliability of a composite score from the 
reliability coefficients and standard deviation of the components and the 
intercorrelations among them. In such a case the reliability coefficient 
should be equivalent insofar as possible to what would have been obtained 
for the group on which the correlation coefficient is based. 



^This problem was discussed at some length in The Amevioan EighSohool 
Student (Flanagan et al,^ 1964, Chapter 2, pp. 2-12 to 2-18, and Appendix 
D-1) . 



How Important Are High Reliability Coefficients? The discussion imme- 
diately preceding has been concerned entirely with the importance of having 
accurate reliability estimates based on appropriate groups . No stress what- 
ever has been placed on having high reliability coefficients. That omission 
was quite deliberate, since in a battery designed solely for research use, as 
the TALENT battery was, where there is no intention of using individual 
scores on individual tests for individual guidance or for making administra- 
tive decisions about the individual student, while there is no disadvantage 
in high reliability, gaining it at the expense of the coverage of the battery 
is disadvantageous. It is a well-known psychometric principle that it is 
better to secure broad coverage of abilities , by having numerous comparative- 
ly short tests, the reliabilities of which are only moderate, or even low 
(though of course significantly and substantially greater than 0) , than to 
cover just a very few abilities, each of which is measured by a very long and 
accordingly very reliable test. (Even in a battery intended for operational 
use — for vocational guidance, for Instance — rather than solely for research, 
the same principle of not sacrificing coverage to bolster individual test 
reliability often applies, since decisions made on the basis of test results 
would be more likely to be based on composite scores, which can be extremely 
reliable even though the component tests have only moderate reliability, than 
on a single test.) If the research based on the short tests Indicates that 
a certain kind of test is a valid predictor of success in a particular area 
or a valid measure of an ability, it is always possible to develop a longer 
test of the same sort later on, for operational use. 

Need to Determine the Reliability of Differences . As was pointed out a 
couple of paragraphs ago, it is sometimes necessary to obtain estimates of 
the reliability coefficients of composite scores. One especially important 
class of such composite scores is the difference score — for instance the 
difference between a grade 9 score and the corresponding grade 12 score. It 
was pointed out in Chapter 3 that the very low reliability usually obtained 
for difference scores has been a stumbling block in the measurement of 
change. This being the case. It is important to be able to get reasonably 
good estimates of just how low (or high) the reliability coefficients for 
these difference scores are. 



f 
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Desirability of Determining the Reliability of Residual Scores . Whenever 
analysis of variance with covariate control is being carried out or when part 
or partial correlations are being obtained, it is helpful, in interpreting 
the results, to know the reliability of residual scores i.e., the reliability 
of scores on a variable after that part that is explainable in terms of an- 
other variable (or set of variables) has been subtracted. 



Methodological Considerations in Determining Test Reliability 



CHOICE OF BASIC METHOD 

Single Administration vs. Parallel Forms i?s. Test-R etest. Parallel forms 
of the TALENT tests were not available, and the test-retest method of deter- 
mining reliability coefficients was neither sound for the tests concerned nor 
feasible from a practical standpoint. The chief reason the test-retest method 
would have been wholly unsatisfactory is that short-term memory would have 
resulted in gross overestimates of test reliability. Elimination of the 
parallel-forms method and the test-retest method from consideration meant that 
it was necessary to resort to some procedure for obtaining reliability esti- 
mates from a single administration of a single form of the test. Fortunately 
this sort of procedure not only was a practical necessity but also had some 
important theoretical advantages. For use in a study of retest data based on 
a single form of the tests, a reliability coefficient based on that same single 
form is probably more generally suitable than a coefficient based on parallel 
forms. 

Split-Half vs. Kuder-Richardson . There are basically only two categories 
of reliability estimation procedures based on a single administration of a 
single form — the split-half approach and the Kuder-Richardson approach 

although each has several versions and variants. 

As has already been implied, the author considers the split-half proced- 
ure preferable, by a considerable margin, to any of the Kuder-Richardson 
formulas, all of which require assumptions that are numerous, restrictive, 
and known to be inapplicable to the TALENT data. 

Suitability of Split-Half Procedure . Of course there are some applica- 
tions for which either the split-half or the Kuder-Richardson approach is 
totally inapplicable. Highly speeded tests are a case in point. As a matter 



4-13 



of fact, if a test is even slightly speeded (and even whan this speeding is 
not part of the test rationale but rather is an unintended by-product of 
practical necessities that result in a too short time allowance) careful 
consideration must be given to such matters as the effect that the speeding 
and the manner of splitting the test have, before deciding whether split- 
half coefficients overestimate the test's reliability substantially, and 
whether this error is sufficiently small that the estimates are still useful. 

Fortunately, as is brought out in the section on speededness at the be- 
ginning of this chapter almost all of the tests that were designed to func- 
tion as essentially unspeeded tests function that way, with 85 percent or 
more of the students finishing, and with the average student finishing at 
least 97 percent (and for most tests closer to 100 percent) of the items. 

Of the two main exceptions. Memory for Words and Information II, the 
former is irrelevant in the present context, since sound reliability esti- 
mates could not be determined for it anyhow, for quite another reason. When 
an entire test depends on a single learning task, as the Memory for Words Test 
does, there is no way of getting wholly defensible reliability estimates for 
it since the items are not experimentally independent and cannot be split in 
any way that will produce experimentally independent halves ; all items are 
linked by being dependent on the examinee's success with the same learning 
task — in this case memorizing the English translations of a list of words in 
a simulated foreign language. Furthermore, when the learning task is a novel 
one, as the Memory for Words task may be to a certain extent, even parallel 
forms wouldn't be the solution since the second encounter with a formerly un- 
familiar task is different from the first encounter with it. 

That leaves Information II as the only test for which the percentage 
incomplete (though not really large) is substantial enough to cast doubt on 
reliability estimates that would otherwise be firm. The possibility remains, 
however, that even though an accurate estimate of reliability is elusive for 
the Information II Total , the reliability of some of the subscales may be 
quite readily determinable. This possibility depends primarily on the fact 
that the completion rate differs for the various subscales, because not all 
of them have items near the end of Information II. 

Let us look, therefore, at the percentages of students finishing each 
Information II scale (shown in Table 4-4) and the mean number and proportion 
of items finished (shown in Table 4-5) . Considering these two sets of data 



jointly, it would appear that several of the Information II subscales are only 
negligibly speeded. Listed in roughly ascending order of apparent speeded- 
ness they are: 



1. 


R-162 


Vocabulary II 


2. 


R-143 


Color Information 


3. 


R-145 


Hunting Information 


4. 


R-136 


Journalism Information 


5. 


R-137 


Foreign Travel Information 


6. 


R-135 


Architecture Information 


7. 


R-133 


Health Information 


8. 


R-142 


Bible Information 



The first five of the scales listed above may be considered to be in effect 
unspeeded for both sexes. The last items for these scales are sufficiently 
far from the end of the test (Item 395) that almost everyone reached them. 

For females only, the sixth of the scales above (R-135) also seems not to be 
speeded. 

A second consideration that may modify the effects of speededness on a 
test’s split-half reliability coefficient is the manner of splitting the test. 
Putting alternate items in each half raises the computed reliability coeffi- 
cient, while putting the first 50 percent of the items in one half and the 
remaining 50 percent in the other half reduces it. Any kind of splitting pro- 
cedure somewhere between these two extremes presumably has an effect somewhere 
between. Table 4-7 contains a column which shows the manner in which each 
test was split. The only Information II scales for which the alternating 
item procedure was not used were Theater and Ballet Information (R— 150) and 
Vocabulary II (R-162) . Thus the Theater and Ballet Information scale should 
probably join the list of Information II variables for which the split-half 
procedure gives a fairly accurate estimate of reliability. (The Vocabulary 
II scale already heads that list since there is empirical evidence that for 
all practical purposes it is essentially unspeeded.) 

Choice of Correction Formula . Having settled on the split-half procedure 
as the basic method to be used in determining the reliability of the TALENT 
tests and having considered the problem of which tests it can be used with, 
the remaining methodological consideration in this area is the choice of 
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correction formula to adjust half-test reliability to the reliability of a 
full-length test. Although the Spearman-Brown formula is certainly the most 
widely used procedure for this purpose, it is this investigator’s opinion 
that Angoff formula 16 is superior on theoretical grounds (Angoff, 1953). 

The assumptions it requires are entirely reasonable, and are less numerous 
and less restrictive than the Spearman-Brown assumptions, at least one of 
which (i.e., the assumption that the two halves have equal standard devia- 
tions) is usually inconsistent with the empirical data. The Angoff formula 
has therefore been used consistently for split-half coefficients reported in 
this chapter. 

ADAPTATION TO OTHER SAMPLES 

As was pointed out earlier in this chapter, after good estimates of a 
test’s reliability have been obtained for a known and describable group, it 
is important to modify them to fit the group to which they are to be applied. 
For this purpose the conventional correction-for-range formula^ is the method 
to be used. As for the "known and describable group” to be used as the start- 
ing point for this procedure of generating reliability coefficients, the 
group of matched retest cases, with each case given equal weight, seemed con- 
venient and suitable and was therefore selected for the role of "seminal 
group.” Split-half reliability coefficients were accordingly obtained for 
this group, separately for each sex and also combined, and are shown in Table 
4-6. The corresponding reliability coefficients for the total retest group 
are also shown in this table, for comparison. They differ little from the 
values for the matched cases. Table 4-6 also shows the means and standard 



(1 - r^) (1) 

standard deviation for group A 
standard deviation for group B 
reliability for group A 
reliability for group B 



1 



The formula is 



'b ' 1 - T 



'B 



where a . = 



*^B 



r. = 



o 

ERIC 



'b = 



TABLE 4 - 6 . Split-lialf reliability coefficients (corrected by Angoff Forniula #l 6 ) 

for grade 12 retest cases; also corresponding means and standard deviations' 
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deviations for the groups on which the reliability coefficients are based. 

The reliability coefficients for the matched group are also repeated in col- 
umns 1 and 2 of Table 4-7, for convenience in comparing them with the other 
values shown in that table. 

Any investigator who wishes to use the formula shown in the footnote on 
page 4-15 in order to adjust a split-half reliability c rficient obtained 
on the retest data to some other group in which he is interested should use 
as r. and a the appropriate reliability coefficient and standard deviation 

A A 

shown in Table 4-6 and as a the standard deviation for his group. This 

U 

formula was used to get estimates of the grade 12 split-half reliability 
coefficients based on the national sample on which the norms presented in 
The American High-School Student (Flanagan et at,, 1964, Chapter 3, Table 
3-2) are based. These reliability coefficients are shown in Table 4-7, col- 
umns 5 and 6. (The standard deviations used in their computation are, shown 
in columns 14-17.) 

Groups on Which Reliability Coefficients for Retest Data Should Be ' 
Based . Reliability coefficients can and should be obtained for many differ- 
ent groups, of course, but what sorts of groups give suitable reliability 

coefficients for use in connection with the retest data? All retest cases? 

2 

Matched cases only? Weighted by Weight Z? Unweighted? The answer is that 
since we want to be able to compare grade 9 and grade 12 data the reliability 
coefficients for the two grades should be based on the same cases. That 
means matched cases. And since we want comparability among tests we shquld 
weight the cases by Weight Z in order to make tests in different sets of re- 
test batteries as comparable as possible. Accordingly, the correction-for- 
range procedure was used to adjust the reliability coefficients in Table 4-6 
based on matched case data (grade 12 cases, unweighted) to the corresponding 
grade 9 and grade 12 values based on weighted matched cases. The resulting 



If his group is small, so that there would be a substantial difference be- 
tween the sample standard deviation and the square root of the unbiased 
population variance estimate, the formula calls for the latter. 

2 

See Chapter 3 for a discussion of Weight Z — its nature and purpose. 
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reliability estimates are shown in columns 1-4 of Table 4-8. The standard 
deviations for the weighted groups to which these reliabilities correspond 
and which were used to compute them are shown in columns 9-12 of Table 4-9, 
columns 3-6 of which contain the corresponding means. 



DETERMmim THE RELIABILITY OF DIFFERENCE SCORES AW RESIDML SCORES 

pliability of Difference Scores . The reliability of raw score differ- 
ences may be determined from the following formulas 



DD 



^ 11^1 ^ 22^2 ~ ^^ 12 ^ 1^2 
Si^ + s^2 - 2r^2"^"2 



( 2 ) 



where the subscript 1 represents grade 9, 

the subscript 2 represents grade 12, and 
D represents the raw score difference. 

Raw score differences between grads 9 scores and grade 12 scores are impor- 
tant when one is interested in amount of gain (or loss) that occurs during the 
interval. 

Differences between standard scores, in contrast, are important when one 
is interested in the change in a student's relative status within his group. 
The formula for the reliability of standard score differences is: 



^dd - z^) (z2 - z^) 



^11 ^22 " ^^12 



2 - 2r 



12 



(3) 



The notation is the same as for formula 2 above? and d equals standard score 
difference . 



Reliability of Residual Scores . The following formula is useful for 
estimating the reliability of the grade 12 residual score on a test after 
the part predicted from the corresponding grade 9 score is subtracted. 



66 = 



2 2 
r r r — 2r ^ 

22 + 11 ^12 ^12 



1 - r 



(4) 



12 



In this formula <S represents the residual. The other notation is the same as 
for formula 2 above. Formula 4 is the one Thorndike derives (Thorndike, 1963, 
p. 70) for reliability of a discrepancy score. 



er|c 
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TABLE 4-8. Reliability coefficients for grade 9 scores, grade 12 scores,’ 

raw and standard score differences, and grade 12 residual scores 

(Based on matched retest cases®, weighted by weight Z) 













SPLIT-HALF RELIABILITY 


COEFFICIENT 






Unweighted 
















c 

Raw score 


Standrscore^ 


Grade 


12« 


N 










Grade 


9^ 


Grade 


12^_ 


difference 


difference 


residual 










No. of 


M 


F 


M 


F 


M 


F 


M 


F 


M 


F 


M 


F 






items 


(1) 


(2) 


(3) 


(4) 


(5) 


(6) 


(7) 


(8) 


(9) 


(10) 


(11) 


(12) 




Information I 




























R-102 


Vocabulary 1 


21 


.786 


.748 


.776 


.776 


.155 


.001 


.154 


-.008 


.243 


.109 


1761 


1917 


R-103 


Literature 


24 


.762 


.704 


.823 


.808 


.305 


.218 


.271 


.133 


.389 


.289 


1761 


1917 


R-104 


Music 


i3 


.720 


.715 


.760 


.718 


.088 


-.095 


.076 


-.095 


.203 


.028 


1761 


1917 


R-105 


Social Studies 


24 


.854 


.814 


.833 


.799 


.393 


.052 


.386 


.048 


.443 


,125 


1761 


1917 


R-106 


Mathematics 


23 


.749 


.710 


.899 


.891 


.591 


.592 


.381 


.364 


.529 


.536 


1761 


1917 


R-107 


Physical Science 


18 


.787 


,711 


.841 


.782 


.293 


.145 


.256 


.107 


.363 


.249 


1761 


1917 


R-108 


Biological Science 


11 


.652 


.552 


.601 


.589 


-.022 


-.113 


-.031 


-.117 


.088 


.066 


1761 


1917 


R-109 


Scientific Attitude 


10 


.594 


.520 


.559 


.504 


.058 


-.013 


.055 


-.013 


.188 


.144 


1761 


1917 


R-110 


Aero .-Space 


10 


.650 


.292 


.665 


.481 


-.044 


-.126 


-.046 


-.165 


.098 


.125 


1761 


1917 


R-111 


Elec. 


20 


.763 


.447 


.833 


.637 


.362 


.218 


.319 


.169 


.438 


.406 


1761 


1917 


R-112 


Mechanics 


19 


.728 


.504 


.706 


.595 


.198 


-.042 


.196 


-.060 


.296 


.150 


1761 


1917 


R-113 


Fanning 


12 


.659 


.686 


.602 


.626 


.016 


-.113 


.005 


-.131 


.121 


-.020 


1761 


1917 


R-114 


Home Economics 


21 


.407 


.648 


.500 


.630 


-.230 


-.023 


-.245 


-.025 


-.002 


.107 


1761 


1917 


R-115 


Sports 


14 


.765 


.508 


.741 


.594 


.164 


-.120 


.159 


-.138 


.250 


.076 


1761 


1917 




Information II 




























R-131 


Art 


12 


.653 


.640 


.669 


.662 


.088 


-.038 


.087 


-.041 


.225 


.109 


1461 


1591 


R-132 


Law 


9 


.567 


.436 


.590 


.539 


.104 


.084 


.103 


.071 


.261 


.282 


1461 


1591 


R-133 


Health 


9 


.673 


.684 


.598 


.541 


.268 


.200 


.256 


.155 


.342 


.220 


1461 


1591 


R-134 


Engineering 


6 


.487 


.377 


.392 


.351 


.052 


-.081 


.043 


-.082 


.160 


.091 


1461 


1591 


R-135 


Architecture 


6 


.287 


.212 


.443 


.365 


-.000 


-.088 


-.020 


-.104 


.231 


.158 


1461 


1591 


R-138 


Military 


7 


.418 


.157 


.470 


.363 


-.060 


-.090 


-.064 


-.117 


.142 


.172 


1461 


1591 


R-139 


Acct. ,Bus. , Sales 


10 


.515 


.520 


.599 


.606 


.178 


.109 


.167 


.096 


.351 


.287 


1461 


1591 


R-140 


Practical Knowledge 


4 


.607 


.470 


.386 


.194 


.101 


-.092 


.035 


-.158 


.088 


-.097 


1461 


1591 


R-142 


Bible 


15 


.741 


.743 


.774 


.780 


.088 


.018 


.078 


.004 


.197 


.124 


1461 


1591 


R-145 


Hunting 


5 


.359 


.000 


.419 


„075 


-.275 


-.259 


-.279 


-.264 


-.041 


-.042 


1461 


1591 


R-146 


Fishing 


5 


.432 


.014 


.524 


.088 


-.116 


-.239 


-.130 


-.241 


.099 


-.023 


1461 


1591 


R-147 


Outdoor Actlv. (other) 


9 


.564 


.452 


.533 


.443 


.043 


-.119 


.041 


-.119 


.182 


.063 


1461 


1591 


R-150 


Theater; Ballet 


8 


.522 


.523 


.596 


.583 


-.041 


-.178 


-.054 


-.187 


.144 


.016 


1461 


1591 


R-162 


Vocabulary II 


9 


.748 


.715 


.709 


.599 


.265 


.142 


.258 


.096 


.344 


.171 


1461 


1591 


R-212 Memory for Words 


24 


.816* 


.856* 


.871* 


.888* 


.698* 


.721* 


.684* 


.713* 


.764* 


.775’ 


1679 


1806 


- 


English 




























R-231 


Spelling 


16 


.672 


.659 


.721 


.638 


.168 


.145 


.157 


.143 


.300 


.263 


1686 


1817 


R-232 


Capitalization 


33 


.840 


.862 


.840 


.888 


.759 


.822 


.759 


.820 


.799 


.862 


1686 


1817 


R-233 


Punctuation 


27 


.763 


.788 


.788 


.800 


.344 


.340 


.339 


.339 


.441 


.430 


1686 


1817 


R-234 


English Usage 


25 


.596 


.586 


.631 


.606 


.193 


.203 


.191 


.202 


.341 


.347 


1686 


1817 


R-235 


Effective Expression 


12 


.708 


.633 


.669 


.622 


.437 


.292 


.434 


.291 


.510 


.406 


1686 


1817 


R-240 


Word Functions 


24 


.801 


.854 


.850 


.866 


.562 


.581 


.546 


.580 


.638 


.642 


1794 


1839 


R-250 Reading Comprehension 


48 


.920 


.924 


.923 


.915 


.727 


.650 


.727 


.648 


.762 


. 679 


1795 


1839 


R-260 Creativity 


20 


.748 


.699 


.816 


.764 


.535 


.433 


.516 


.420 


.628 


.546 


1795 


1839 


R-270 Mechanical Reasoning 


20 


.839 


.701 


.829 


.746 


.515 


.241 


.514 


.232 


.575 


.362 


1795 


1839 


R-282 


Vis. in 3 Dimensions 


16 


.767 


.684 


.784 


.712 


.439 


.262 


.438 


.259 


.530 


.336 


1795 


1839 


R-290 


Abstract Reasoning 


15 


.746 


.734 


.717 


.731 


.382 


.330 


.379 


.330 


.461 


.428 


3382 


3628 




Mathematics 




























R-311 


I . Ar 1 1 h . Re ason Ing 


16 


.739 


.696 


.771 


.758 


.305 


.170 


.299 


.148 


.413 


.291 


1686 


1817 


R-312 


II. Intro, h.s. Math. 


24 


.795 


.756 


.890 


.845 


.583 


.448 


.495 


.388 


.607 


.513 


1686 


1817 


R-333 


III.Adv. h.s. Math. 


14 


.200 


.136 


.786 


.696 


.585 


.481 


1 .342 


.312 


.730 


. 668 


1676 


1807 



®For each variable all cases were used that had scores for both grade 9 and grade 12. 
^Obtained from the split-half coefficients in Table 4-7, columns 1~2, by means of formula 1. 



From formula 2 . 

^From formula 3« 

^Frorn formula 4- 

*These reliability coefficients are probably overestimates, (See footnote for Table 4-7.) 



TABLE A-*9. Correlation between grades, and raw score means and standard deviations, 
corresponding to reliability coefficients in Table 4-8 

(Based on matched retest cases^ weighted by weight Z) 









V between^ 


MEAN 


STANDARD DEVIATION (s) 


I'nweighced 








grades 










Raw score 










Raw score. 


V 

4' 


1 










Gr. 


9 


Gr. 


12 


difference 


Gr. 


9 


Gr. 


12 


difference 










No, of 


M F 


M 


F 


M 


F 


M 


F 


M 


F 


M 


F 


M 


F 


M 


F 






items 


(1) (2) 


(3) 


(4) 


(5) 


(6) 


(7) 


(8) 


(9) 


(10) 


(XI) 


(12) 


(13) 


(14) 


(15) 


(16) 




Information 1 






R-102 


Vocabulary I 


21 


.741 .764 


11.97 


10.67 


14.57 


13.34 


2,60 


2.67 


3.80 


3,86 


3.71 


4.09 


2.70 


2.74 


1761 


1917 


R-103 


Literature 


24 


.715 .718 


10. 72 


10.48 


15.05 


15.12 


4.33 


4.64 


4.11 


3.80 


4.75 


4.72 


3.40 


3.31 


1761 


1917 


R-104 


MuF'f c 


13 


.719 .741 


5.64 


6.21 


6,60 


7.18 


.96 


.97 


2.87 


2.82 


3.10 


2.84 


2.25 


2.04 


1761 


1917 


R-1,05 


Social Studies 


24 


.745 .797 


14.57 


12.60 


17.57 


15.68 


3.00 


3.08 


5.29 


4.91 


4.94 


4.72 


3.67 


3.07 


1761 


1917 


R-106 


Mathematics 


23 


.716 .686 


7.93 


7.05 


12.24 


9.16 


4.31 


2.11 


4.03 


3.61 


6.35 


5.88 


4.47 


4.30 


1761 


1917 


R-107 


Physical Science 


18 


.750 ,716 


9.67 


7.84 


11.25 


8.37 


1.58 


.53 


3.69 


3.51 


4.26 


4.04 


2.86 


2.88 


1761 


1917 


R-108 


Biological Science 


11 


.638 .615 


5.95 


4.88 


7.15 


6.03 


1.20 


1.15 


2.28 


2.14 


2.13 


2.24 


1.88 


1.92 


1761 


1917 


R-109 


Scientific Attitude 


10 


.552 .519 


5.48 


5.52 


6.78 


6.82 


1.30 


1.30 


1.99 


1.86 


1.91 


1.83 


1.85 


1.81 


1761 


1917 


R-110 


Aero. -Space 


10 


.673 .474 


4.59 


2.76 


5.92 


3.64 


1.33 


.88 


2.35 


1.64 


2.40 


1.92 


1.93 


1.84 


1761 


1917 


R-111 


Elec. 


20 


.703 .449 


8.56 


5.55 


11.25 


6.25 


2.69 


.70 


3.87 


2.54 


4.61 


3.14 


3.34 


3.03 


1761 


1917 


R-112 


Mechanics 


19 


.648 .575 


11.14 


7.18 


13.56 


8.79 


2,42 


1.61 


3.28 


2.72 


3.15 


3.02 


2.70 


2.66 


1761 


1917 


R-113 


Farming 


12 


.628 .696 


7.61 


6.90 


8.57 


7.91 


.96 


1.01 


2.28 


2.51 


2.12 


2.30 


1.90 


1.89 


1761 


1917 


R--114 


Home Economics 


21 


,561 .648 


7.74 


11.80 


9.29 


13.75 


1.55 


1.95 


2.75 


3.29 


2.99 


3.21 


2.70 


2.73 


1761 


1917 


R-115 


Sports 


14 


.706 .605 


7.57 


5.10 


9.21 


6.41 


1.64 


1.31 


2.94 


2.27 


2.80 


2.50 


2.20 


2,13 


1761 


1917 




Information II 


































R-131 


Art 


12 


.629 .665 


5.59 


5.91 


6.96 


7.39 


1.37 


1.48 


2.46 


2.44 


2.52 


2.52 


2.15 


2.03 


1461 


1591 


R-132 


Law 


9 


.530 .448 


4.38 


3.96 


5.86 


5.35 


1.48 


1.39 


1.78 


1.61 


1.83 


1.78 


1.75 


1.78 


1461 


1591 


R-133 


Health 


9 


.510 .541 


5.18 


5.60 


6.36 


6.82 


1.18 


1.22 


2.04 


1.95 


1.84 


1.62 


1.92 


1.73 


1461 


1591 


R-134 


Engineering 


6 


.414 .412 


3.03 


2.49 


3.52 


3.03 


.49 


.54 


1.24 


1.26 


1.14 


1.24 


1.30 


1.35 


1461 


1591 


R-135 


Architecture 


6 


,378 .356 


2.28 


2.33 


2.86 


2.85 


.58 


.52 


1.25 


1.19 


1.42 


1.32 


1.49 


1.43 


1461 


1591 


1 R-138 


Military 


7 


.477 .338 


2.16 


1.64 


3.12 


2.39 


.96 


.75 


1.38 


1.14 


1.44 


1.31 


1.44 


1.41 


1461 


1591 


, R-139 


Acct., Bus., Sales 


10 


.468 .517 


4.04 


4.02 


, 5.61 


5.75 


1.57 


1.73 


1.79 


1.75 


1.97 


1.94 


1.95 


1.82 


1461 


1591 


R-140 


Practical Knowledge 


4 


.478 .423 


2.79 


2.95 


3.26 


3.35 


.47 


.40 


1.04 


.90 


.84 


.73 


.98 


.89 


1461 


1591 


R-142 


Bible 


15 


.737 .761 


6.61 


6.84 


7.85 


8.09 


1.24 


1.25 


3.22 


3.12 


3.44 


3.36 


2.42 


2.25 


1461 


1591 


j R-145 


Hunting 


5 


.523 .239 


2.10 


1.05 


2.54 


1.18 


.44 


.13 


1.20 


.89 


1.26 


.96 


1.20 


1.14 


1461 


1591 


i R-146 


Fishing 


5 


.538 .235 


1.67 


.98 


2.09 


1.07 


.42 


.09 


1.23 


.91 


1.34 


.94 


1.24 


1.14 


1461 


1591 


i R-147 


Outdoor Activ. (other) 


9 


.529 .506 


4.66 


4.18 


5.41 


4.88 


.75 


.70 


1.87 


1.81 


1.80 


1.79 


1.78 


1.79 


1461 


1591 


] R-150 

* 


Theater; Ballet 


8 


.582 .623 


3.44 


4.05 


4.41 


4.97 


.97 


.92 


1.61 


1.61 


1. 75 


1.73 


1.54 


1.45 


1461 


1591 


1 R-162 


Vocabulary II 


9 


.634 .620 


5.26 


5.71 


6.70 


6.86 


1.44 


1.15 


2.24 


2.14 


2.08 


1.81 


1.85 


1.75 


1461 


1591 


i R-212 


Memory for Words 


24 


.504 .554 


10.24 


11.71 


12.46 


14.70 


2.22 


2.99 


4.79 


5.18 


5.72 


5.88 


5.29 


5.26 


1679 


1806 


^ R-220 

f 


Disguised Words 


30 


.585 -.607 


12.86 


14.14 


16.57 


18.14 


3.71 


4.00 


6.15 


6.35 


7.52 


7.58 


6.35 


6.27 


1795 


1840 


1 


English 


































j R-231 


Spelling 


16 


.640 .590 


7.96 


9.26 


9.63 


11.19 


1.67 


1.93 


2.87 


2.74 


3.12 


2.66 


2.55 


2.45 


1686 


1817 


R-232 


Capitalization 


33 


.337 .305 


28.45 


29.64 


29.52 


30.41 


1.07 


.77 


3.87 


3.40 


3.86 


3.78 


4.46 


4.25 


1686 


1817 


1 R-233 


Punctuation 


27 


.660 .688 


16.07 


17.81 


18.23 


20.16 


2.16 


2.35 


4.30 


4.13 


4.55 


4.25 


3.65 


3.32 


1686 


1817 


1 R-234 


English Usage 


25 


.522 .493 


15.53 


16.46 


16.99 


17.81 


1.46 


1.35 


3.26 


3.04 


3.41 


3.12 


3.26 


3.10 


1686 


1817 


! R-235 


Effective Expression 


12 


.451 .474 


7.78 


8.35 


8.99 


9.46 


1.21 


1.11 


2.48 


2.15 


2.33 


2.12 


2.52 


2.19 


1686 


1817 


R-240 


Word Functions 


24 


.615 .667 


8.70 


10.18 


11.50 


13.10 


2.80 


2.92 


4.82 


5.35 


5.55 


5.61 


4.59 


4.48 


1794 


1839 


R-250 


Reading Comprehension 


48 


.712 .771 


26.62 


28.14 


32.93 


34.13 


6.31 


5.99 


10.56 


10.07 


10. 71 


9.56 


8.07 


6.65 


1795 


1839 


i R-260 


Creativity 


20 


.549 .537 


8.33 


7.80 


11.61 


10.58 


3.28 


2.78 


3.77 


3.50 


4.41 


3.95 


3.92 


3.60 


1795 


1839 


i R-270 


Mechanical Reasoning 


20 


.658 .640 


11.88 


8.25 


14.28 


9.84 


2.40 


1.59 


3.93 


3.41 


3.82 


3.69 


3.21 


3.02 


1795 


1839 


1 R-281 


Vis. in 2 Dimensions 


24 


.492 .571 


13.14 


11.15 


16.18 


13.59 


3.04 


2.44 


5.70 


5.51 


5.43 


5.55 


5.61 


5.12 


1795 


1839 


i R-282 


Vis. in 3 Dimensions 


16 


.601 .592 


8.59 


7.86 


10.44 


9.09 


1.85 


1.23 


3.21 


2.92 


3.34 


3.06 


2.93 


2.70 


1795 


1839 


1 R-290 


Abstract Reasoning 


15 


.568 .601 


8.75 


8.51 


10.15 


9.74 


1.40 


1.23 


3.00 


2.96 


2.84 


2.95 


2.72 


2.64 


3382 


3628 


■’ 


Mathematics 


































i R-311 


I. Arith. Reasoning 


16 


.650 .679 


7.98 


7.65 


10.14 


9.18 


2.16 


•1.53 


3.38 


3.20 


3.60 


3.59 


2.93 


2.74 


1686 


1817 


R-312 


II. Intro, h.s. Math. 


24 


.688 .674 


10.08 


10.24 


12.75 


11.01 


2.67 


.77 


4.06 


3.87 


5.54 


4.85 


4.03 


3.63 


1686 


1817 


? R-333 


III.Adv. h.s. Math. 


14 


.229 .152 


2.46 


2.31 


4.58 


3.46 


2.12 


1.15 


1.63 


1.51 


3.14 


2.54 


3.19 


2.75 


1676 


1807 


F-410 


Arithmetic Computation 


72 


.465 .461 


25.14 


30.42 


34.15 


36.46 


9.01 


6.04 


20.14 


16.21 


19.94 


17.28 


20.73 


17.42 


1686 


1817 


F-420 


Table Reading 


72 


.155 .241 


6.26 


8.53 


11.74 


12.97 


5.48 


4.44 


10.10 


7.74 


10.71 


6.50 


13.53 


8.83 


1789 


1839 


F-430 


Clerical Checking 


74 


.270 .278 


16.72 


23.57 


28.18 


34.06 


11.46 


10.49 


19.83 


17.73 


17.18 


15.90 


22.46 


20.27 


1773 


1829 


F-440 


Object Inspection 


40 


.287 .407 


19.48 


20.94 


24.31 


25.15 


4.83 


4.21 


8.44 


7.30 


8.68 


7.30 


10.22 


7.95 


1761 


1815 



Based on the same cases as Table 4-8. 



^From Tables I-l and 1-2 in Appendix I. 
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STANDARD ERRORS OF MEASUREMENT 

Although we have elected in the interests of convenience to discuss 
standard errors of measurement under the general heading ’’Reliability of the 
Tests” the reader is urged to bear in mind that standard errors of measure- 
ment should be considered neither ’’better” than reliability coefficients nor 
substitutes for them, in evaluating a test. Their sole function is to aid in 
interpreting scores , by providing a scale which expresses amount of score un- 
reliability in terms of the same units as the scores themselves. 

The standard errors of measurement have been computed from the general 

formula: 

a =0 Wl - r 

meas x\ xx 

X 

where x may be a raw score, standard score, difference score, or any other 
kind of measure. The only restriction is that and r^^ must be based on 

the same (or essentially equivalent) groups. 

The standard error of measurement of the difference between standard 

scores for grades 9 and 12 reduces to: 



The notation is the same as for formulas 2 and 3 above. 

\\ 

Results 

FINDINGS ON RELIABILITY 

Reliability of Test Scores for Retest Group . For reasons already ex- 
plained, columns 1-4 of Table 4-8 contain the most useful estimates of the 
reliability of test scores within a single grade (9 or 12) , for the retest 
group. As might be expected, the grade 12 coefficients turn out to be of 
about the same order of magnitude as the ones in columns 1 and 2 of Table 
4-7. Inspection of the coefficients in columns 1-4 of Table 4-8 reveals that 
oW of the long tests have excellent reliability and that even for the shorter 
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tests reliability is generally quite good when length is taken into account. 

A notable exception is Photography Information (R-148) which has poor 
reliability for both sexes but particularly for girls. The poor reliability 
is undoubtedly due to the fact that one of the three items not only 
was extremely difficult but had a dis tractor that turned out to be unusually 
attractive throughout the range of ability, for reasons discussed in The 
Amerioan High -School Student, Chapter 3 (Flanagan et at., 1964, p. 3-114). 

The low reliability of the Etiquette Information scale (R-144) is of course 
due primarily to its brevity (only two items) but it is also due partly to 
the fact that one of the items proved extremely difficult, especially for, the 
boys, while the other item was moderately easy. (The difference in diffi<?ulty 
levels between the two items reduced the phi coefficient between them, which 
represented the half-test reliability.) - 

The few other variables for which the reliability is extremely low are 
almost all ones in areas where the students' knowledge is typically so scanty 
that responses are likely to be based largely on guessing. Hunting Informa- 
tion (R— 145) and Fishing Information (R— 146) for grade 9 girls are instances . 
For the same reason, the reliability coefficient is a lot lower for girls than 
for boys on Aeronautics and Space Information (R-110) and Electrical-Elec- 
tronic Information (R-111) , and for boys than for girls on Home Economics 
Information (R-114) . 

Lack of knowledge, with consequent extensive guessing and restriction 
of range, also explains the low 9th-grade reliability coefficients for Math 
III (R-333) , which tests mastery of mathematical concepts not usually taught 
until after grade 9. 

Alternative Sources of Information about Test Reliability . Reliability 
coefficients, as computed, are not the only source of information about a 
test's reliability. Under some circumstances other statistics may give even 
better though less direct information about it. Consider, for instance, the 
fact that except for sampling errors a test's reliability cannot be lower 
than the square of any correlation involving that test, and the related fact 
that (again except for sampling errors) the communality of a test included 
in a factor analysis cannot exceed its reliability. Table 6-6 shows commu- 
nality estimates based on approximately the same cases as the Table 4-8 

reliability coefficients, and weighted the same way. In some cases the 

i 
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communality estimates turn out to be enough higher to suggest that the test 
may be considerably more reliable than its computed reliability coefficient 
suggests. Hunting Information (R-145) for grade 12 girls is a case in point. 

Its computed reliability coefficient for this group is only .075 (column 4 of 
Table 4-8). It seems improbable that a variable whose reliability is really 
that low could have a communality as high as .477, virtually all of it composed 
of factors that look plausible and have reasonable interpretations. This is 
presumably a case where the internal consistency is not really a sound estimate 
of reliability, since the individual items themselves are probably somewhat 
more reliable than homogeneous. (Item reliability and inter-item homogeneity 
are not always exactly synonymous.) 

Correlations corrected for attenuation constitute an even better clue 
concerning lower bounds of a test's reliability. If the correlation corrected 
for attenuation goes over 1, it means that either the raw correlation is an 
overestimate or the reliability coefficient of at least one of the two variables 
correlated is an underestimate. In columns 3-4 of Table 5-3 are the correla- 
tions between corresponding grade 9 and grade 12 variables corrected for 
attenuation. Several of these corrected correlations for scales in the Informa- 
tion Test are greater than 1, suggesting that the reliability coefficients for 
the information scales tend to be underestimates. 

Reliability of Test Scores for Norms Group: Grade 12 . For reasons already 

explained, the coefficients shown in columns 5 and 6 of Table 4-7 are the best 
estimates currently available of the reliability of the grade 12 scores for 
the group on which the TALENT norms presented in The Amevvoan High-Sohool 
Student (Flanagan et dl,y 1964, Chapter 3) are based. (The reliability 
coefficients in columns 5-6 turn out to be quite close to the ones in columns 
1-2.) 

Reliability of Difference Scores . Columns 5-6 of Table 4-8 show the 
reliability of the differences between grade 9 raw scores and corresponding 
grade 12 scores. The means and standard deviations of these difference scores 
are shown in Table 4-9, in columns 7-8 and 13-14 respectively. Columns 7-8 
of Table 4-8 show the reliability coefficients for the difference between 
standard scores . The correlations between grades are shown in columns 1-2 of 
Table 4-9. As was to be expected in view of the substantial correlations between 
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grade 9 and grade 12 scores on most of the tests, most of the reliability 
coefficients for difference scores were low. But many were substantial and some 
were surprisingly high. Among the latter were Reading Comprehension (R-250) , 

Word Functions in Sentences (R— 240) , Math Information (R— 106) , Math II (R— 312) , 
and Math III (R-333). Capitalization (R-232) has very high reliability coefficients 
for difference scores, but this is probably an artifact, due, perhaps, to some 
bort of distortion caused by a grossly skewed distribution of scores. 

For almost every test, differences between standard scores (columns 7-8) 
have roughly the same reliability as differences between raw scores (columns 
5-6). Some of the math variables constitute the chief exception. For those 
variables the reliability of raw score differences tends to be substantially 
higher than that of standard score differences. 

It has already been indicated (in the paragraph headed "Alternative 
Sources of Information about Test Reliability' ) that the computed values of 
the reliability coefficients for the information scales (at least for many of 
them if not all) tend to be underestimates. For any scales in this category 
whose reliability coefficients for either grade 9 or grade 12 or both are 
underestimates the reliability coefficients for difference scores tend likewise 
to be underestimates. This is true both for raw-score and standard-score 
differences. 

Reliability of Residual Scores . The residual twelfth-grade scores (after 
subtracting the component predictable from ninth-grade score on the same test) 
turned out to be considerably more reliable than either the raw-score differ- 
ences or the standard-score differences. Almost all of these residual-score 
reliability coefficients (shown in columns 9-10 of Table 4-8) appear to be 
g if leant ly greater than 0 (although the author knows of no formula for an 
exact test of significance suitable for reliability coefficients determined the 
way these were). The fact that the residual scores turn out to have such 
substantial reliability is gratifying since most of the research reported on 
in Chapters 7 and 8 involves residuals of one kind or another. 

Furthermore, as has already been indicated, many of the reliability 
coefficients shown for the various information scales and for difference 
scores on them are probably underestimates. The same conclusion applies to 
the reliability coefficients for residual scores on these variables. 
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Standard Errors of Measurement . Standard errors of measurement are 
presented in Table 4-10, for grade 9 scores, grade 12 scores, and raw-score 
differences. They are all based on the weighted retest cases, and are 
computed from the appropriate reliability coefficients and standard deviations 
in columns 1-8 of Table 4-8 and 9-14 of Table 4-9. 

EMPIRICAL FINDINGS ON METHODOLOGY 

Comparison of KR-21 and Split -Half Coefficients . In order to provide 
some notion, based on empirical data, of the amount of distortion produced by 
the use of the KR-21 formula, KR-21 coefficients corresponding to the split- 
half coefficients in Table 4-7 also appear in that table. Columns 3-4 and 7-8 
show KR-21 values corresponding directly to split-half coefficients. It is 
clear that the KR values are systematically, and in some cases substantially, 
lower than the corresponding split-half estimates. This is of course in 
accordance with expectation. KR-21 can be expected to underestimate the reli- 
ability (of unspeeded tests) unless the items are all of identical difficulty 
and identical reliability, and unless the item intercorrelations equal the 
item reliabilities — a most improbable set of assumptions for most tests. The 
sole case where the KR-21 coefficient is higher than the corresponding split- 
half value is for the Reading Comprehension Test (R-250) , for which KR-21 is 
spuriously increased by the fact that items based on the same reading passage 
are not experimentally independent. (This difficulty does not apply to the 
split-half reliability because the manner of splitting the test controls it.) 

The KR-21 coefficient on this test happens to be higher than the split-half 
value for males but not for females, even though it is of course subject to the 
same spurious increase for females as for males. 

Comparison of Split-Half Coefficients with Values Obtained by Other 
Procedures . Where coefficients obtained by methods other than KR-21 were 
originally obtained for the norms group (as presented in Table 2-5 of Flanagan 
et al.f 1964) they too are shown in Table 4-7 (in columns 12-13). These 
coefficients are mostly either split-half coefficients based on the experimental 
form of the test and corrected for number of items and range, or KR-20's. 

The details are explained in the original report (Flanagan et dl., 1964, 

Chapter 2). In Table 4-7 of the present report, it will be seen that the values 
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TABLE 4-10. Standard errors of measurement for various kinds of scores 
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R-102 


Information I 
Vocabulary I 


No. of 
items 

21 


Within- 
grade 
(9 and 12) 
M F 

1.76 1.94 


For 

raw score 
difference 
M F 

2.48 2.74 


R-103 


Literature 


24 


2.00 


2.07 


2.84 


2.93 


R-104 


Music 


13 


1.52 


1.51 


2.15 


2.04 


R-105 


Social Studies 


24 


2.02 


2.12 


2.86 


2.99 


R-106 


Mathematics 


23 


2.02 


1.94 


2.86 


2.75 


R-107 


Physical Science 


18 


1.70 


1.89 


2.40 


2.66 


R-108 


Biological Science 


11 


1.35 


1.44 


1.88 


1.92 


R-109 


Scientific Attitude 


10 


1.27 


1.29 


1.80 


1.81 


R-110 


Aero. -Space 


10 


1.39 


1.38 


1.93 


1.84 


R-111 


Electricity and Electronics 


20 


1.88 


1.89 


2.67 


2.68 


R-112 


Mechanics 


19 


1.71 


1.92 


2.42 


2.66 


R-113 


Farming 


12 


1.34 


1.41 


1.88 


1.89 


R-114 


Home. Economics 


21 


2.12 


1.95 


2.70 


2.73 


R-115 


Sports 


14 


1.42 


1.59 


2.01 


2.13 


R-131 


Information II 
Art 


12 


1.45 


1.47 


2.05 


2.03 


R-132 


Law 


9 


1.17 


1.21 


1 . 66 


1.70 


R-133 


Health 


9 


1.17 


1.10 


1.64 


1.55 


R-134 


Engineering 


6 


.89 


1.00 


1.27 


1.35 


R-135 


Architecture 


6 


1.06 


1.05 


1.49 


1.43 


R-138 


Military 


7 


1.05 


1.05 


1.44' 


1.41 


R-139 


Acct. , Bus. , Sales 


10 


1.25 


1.22 


1.87 


1.72 


R-140 


Practical Knowledge 


4 


. 66 


. 66 


.93 


.89 


R-142 


Bible 


15 


1.64 


1.58 


2.31 


2.23 


R-145 


Hunting 


5 


.96 


.89 


1.20 


1.14 


R-146 


Fishing 


5 


,92 


.90 


1.24 


1.14 


R-147 


Outdoor Activities (other) 


9 


1.23 


1.34 


1.74 


1.79 


R-150 


Theater; Ballet 


8 


1.11 


1.12 


1.54 


1.45 


R-162 


Vocabulary II 


9 


1.12 


1.15 


1.59 


1.62 


R-212 


Memory for Words 


24 


2.06 


1.97 


2.91 


2.78 


R-231 


English 

Spelling 


16 


1.65 


1.60 


2.33 


2.27 


R-232 


Capitalization 


33 


1.54 


1.26 


2.19 


1.79 


R-233 


Punctuation 


27 


2.10 


1.90 


2.96 


2.70 


R-234 


English Usage 


25 


2.07 


1.96 


2.93 


2.77 


R-235 


Effective Expression 


12 


1.34 


1.30 


1.89 


1.84 


R-240 


Word Functions 


24 


2.15 


2.05 


3.04 


2.90 


R-250 


Reading Comprehension 


48 


2.99 


2.79 


4.22 


3.94 


R-260 


Creativity 


20 


1.89 


1.92 


2.67 


2.71 


R-270 


Mechanical Reasoning 


20 


1.58 


1.86 


2.24 


2.63 


R-282 


Visualization in 3 Dimensions 


16 


1.55 


1.64 


2.20 


2,32 


R-290 


Abstract Reasoning 


15 


1.51 


1.53 


2.14 


2.16 


R-311 


Mathematics 

I. Arithmetic Reasoning 


16 


1.72 


1.77 , 


2.44 


2.50 


R-312 


II. Intro, h.s. Math. 


24 


1.84 


1.91 


2.60 


2.70 


R-333 


III. Adv. h.s. Math. 


14 


1.45 


1.40 


2.06 


1.98 



* 

Based on the data of Tables 4-8 and 4-9. 
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in columns 5-6 are a little higher, in most cases, than the corresponding values 
in columns 12-13, obtained by other means. The exceptions are trivial. 

Empirical Check on Correction for Range . To obtain a notion based on 
empirical data, of just how good the correction-for-range procedure on which we 
are leaning so heavily is, the KR-21 estimates in Table 4-7, columns 7-8, 
obtained by this procedure for the 1960 norms group may be compared with the 
corresponding KR-21 values in columns 9—10, which were obtained directly from 
the 1960 norms data. This comparison suggests that the correction-for-range 
procedure is very good indeed. The values it gives (columns 7-8) are almost 
identical to those obtained by direct computation (columns 9-10). 



CLERICAL ACCURACY AND CONSCIENTIOUSNESS OF EXAMINEES 

One matter of concern in any program involving tests and questionnaires 
is whether the students approach the task conscientiously, and try to answer 
as carefully and as accurately as they can. The circumstances of the retest 
administration provided an unusually good opportunity to check this point, at 
least with respect to the students* approach to questionnaires such as the 
Student Information Blank. And as far as students* attitude towards tests is 
concerned, the Screening scale (R-101) of the Information Test was developed 
for the explicit purpose of checking on this very point, among others (Flanagan 
et dl.i 1960, Chapter VII, pp. 30-34). 

Manner of Response to Tests 

The Screening scale consists of a dozen items which were intentionally 
made so easy that anyone who can read and write simple English should have no 
difficulty with any of them. Therefore 12th-grade students who answer items 
incorrectly have probably made a clerical error in marking the answer sheet. 
Students who mark answer sheets carelessly or are unusually prone to clerical 
error would be am ong those most likely to get something less than a perfect 
score on the Screening scale. About 25 percent of the boys and 18 percent of 
the girls fall in this category, according to Table 4-11, which shows the per- 
centage distribution of Screening scores, based on matched cases. 
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If we subtract from the percentages who failed to get perfect scores on 
the Screening Test the percentages (shown in Table 4-4) that failed to finish, 

we are left with at least 19 percent of the boys and 15 percent of the girls 
making at least one actual error on the Screening Test. This is a palpable 
amount of error, but quite in line with what is to be expected of human beings, 
and certainly not large enough to cast doubt on findings based on the results 
of the retesting. 

Of course results from the Clerical Checking Test also attest to the 
prevalence of clerical inaccuracy, but those results are not quite so relevant 
as the Screening scale data to what we are talking about here. The greater 
relevance of the Screening scale is due to the fact that unlike the Clerical 
Checking Test, it measures performance under essentially unspeeded conditions. 
The Clerical Checking Test, on the other hand, imposes a very stringent (and 
deliberately stingy) time limit. 

As for the amount of inaccuracy revealed by the Screening Test data, it 
is reassuring to note that the percentage distributions shown in Table 4-11 
are almost identical with the corresponding distributions for the national 
sample of 12th-graders tested in 1960 (as shown in Table 3-4 of The Amerioan 
HighSohoot Student ^ Flanagan et al,, 1964). This, together with the general 
similarity between grade 12 results in 1960 and 1963 on most other tests in 
the TALENT battery, suggests that being required by their schools to participate 
in Project TALENT a second time did not result in uncooperativeness, blatant 
carelessness, or any other attitudinal change that affected test performance 
noticeably. 

Manner of Response to Inventories 

The SIB administered in 1963 was much shorter than the 1960 version; it 
contained only 158 items instead of the original 394. But practical considera- 
tions dictated that the original answer sheet format, set up for 394 items, 
had to be retained in the 1963 testing. As a result of the varying number of 
options for different items, some items were in positions where the number of 
answer spaces printed didn’t match the number of options for the item. As a 
matter of fact, the new SIB contained 52 such items, with fewer options than 
answer spaces. These 52 items were used as the basis for "goof scores," 



TABLE 4-11. Percentage distribution of Screening scores (R-101) 
Based on retest matched cases, weighted by Weight Z 



R-101 


Percent 


Score 


M 


F 


12 


74.8 


81.9 


11 


14.4 


12.1 


10 


2.9 


2.6 


9 


3.3 


2.2 


8 


3.1 


.8 


7 


.8 


.3 


6 


.4 


.1 


5 






4 


.1 




3 






2 






1 


.1 




0 


.1 




Total 


100.0 


100.0 



M* 


11.5 


11.7 


0* 


1.2 


.8 


N** 


1950 


2091 



Weighted 



Unweighted 



determined for each student who took the SIB in 1963. A student’s "goof scores" 
are measures of the extent to which he marked answer spaces corresponding to 
nonexistent options. 

The term "goof score" was assigned to these variables as a working label, 
presumably on an interim basis, pending the arrival of an inspiration as to a 
name that would be equally descriptive but somewhat more formal. But, since 
inspiration didn't materialize, the name "goof score" stuck. And that is why it 
is the name used in this report! 

The procedure for determining the goof scores is described in Appendix D-2, 
Section 2. Appendix F consists in a general discussion of them and their 
implications, and a presentation of empirical findings. 

If a student marked either a part or all of his answers to the SIB at 
random he would probably have high goof scores, as he likewise would if he 
were exceptionally careless. As pointed out in Appendix F, almost all of the 
SIB's with high goof scores can be eliminated from specific analyses where it 
seems desirable to do so, by eliminating cases that have a "goof-1" score 
(X— 801 ' ) greater than 0. However for most analyses this would be unnecessarily 
costly in terms of cases. It would reduce the number of cases available for 
the analyses by over 40 percent, which would generally be undesirable since 
many accurately marked responses would be thrown out to get rid of a very few 
inaccurate ones. But even so, conceivably it could be worthwhile for some 
analyses where the N is large enough that even a drastic reduction in it is not 
serious enough to outweigh the advantages of eliminating inaccurate data. 

Another possible approach, mentioned briefly in Appendix F, is to eliminate 
cases from the analyses not on the basis of goof-1 scores but instead on the 
basis of "goof-responses" to the first four of the ten items going into it 
(Items 57-60). This somewhat less stringent approach is less costly in terms 
of loss of cases, but of course it is also less efficient in purifying the data. 

On the other hand elimination of any sizable group of cases on the basis 
of invalid responses to early items in the SIB, in situations where the only 
SIB items to be used in the data analysis are late ones, would be most clearly 
justifiable if selection of an invalid response were a random event occurring 
with a probability approximately proportional to the reciprocal of the number 
of answer spaces for the item. But this doesn't happen. If it did, we wouldn't 
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have had the phenomenon, already mentioned, of having the first four of the 
52 items be among the ones more likely to have invalid responses than other 

items for which the same opportunity existed. 

Furthermore, as pointed out in Appendix F there is a decrease, rather than 
an increase, in the occurrence of goof responses towards the end of the inventory. 
Quite evidently, boredom, fatigue, and indifference toward the end are not 
playing any important role in the goof responses. Errors on the first en- 
counters with items entering into the goof scores are by far the most prevalent 
ones. The students cope with the situation better on the later items where they 
are familiar with it. This further emphasizes the fact that throwing out later 
responses because an initial one is invalid may be wasteful of valid data. 

Those are the pros and cons of eliminating cases from analyses on the 
basis of goof scores (or some similar criterion). Any investigator who happens 
to be using retest SIB data in his study will have to make a decision on the 
basis of the nature and purpose of his study and the specific kinds of analyses 

he happens to be doing. 

Evaluation of Effect on Present Study 

The effect on the present study of the problem discussed above (inaccuracies 
in answer-sheet marking) seems to be virtually nil, for at least two reasons. 

In the first place, there is no evidence that a problem of any magnitude exists 
in regard to the cognitive tests, or, for that matter, in regard to anything 
except the 1963 SIB. And the present study concentrates almost exclusively on 
the cognitive tests. The only part of it in which items from the 1963 SIB 

are involved is in the Chapter 8 analyses. 

This brings us to the second reason the problem of errors in answer- 
sheet marking doesn’t affect the present study in any important way. Even 
where items from the 1963 Sp are used (i.e.. Chapter 8) only a small set of 
them are used, for most of which there is no reason to expect undue error since 
they are not among the 52 having excess answer spaces. And the rather small 
proportion of cases having invalid responses on the one "goof item" that was 
included would automatically have been eliminated from the data analyses 
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on which Chapter 8 is based. 



SUMMARY 



This chapter has been concerned with three main topics — (1) the degree 
of speededness, if any, of the tests (and Interest Inventory), (2) the reliability 
of the tests, and (3) the degree to which responses on tests and inventories 
are subject to answer-sheet-marking errors. The first and third of these 
topics are important not only in their own right but also because they have 
bearing on the second topic, test reliability. 

Findings and Conclusions 

1, Speededness of Tests . Most of the tests turned out to be speeded (or 
unspeeded) to just about the degree that was specified in the original 
test rationale. The chief exception was the Infomation Test, Part II, 
which turned out to be a little more speeded for the retest group in 
1963 (though not for the original grade 12 norms group in 1960) than 
had been intended. Distortion caused by this is probably not great, 
however. 

2. Answer- Sheet -Marking Errors . Although there is of course some clerical 
error in marking answer sheets, its frequency of occurrence appears 

to be fairly low. On the Student Information Blank a substantial 
number of students apparently made some errors because of confusion 
induced by the fact that as a result of revision of the SIB some of 
the items had fewer options than there were answer spaces on the 
answer sheet. Most such errors can be eliminated from data analyses 
by eliminating certain cases on the basis of a few easily definable 
criteria. A consideration of the pros and cons of this data-purif ica- 
tion procedure results in the very tentative conclusion that for most 
purposes its disadvantages probably outweigh its advantages. In 
any event there is no reason to believe the present study has been 
affected, since the problem doesn’t apply to any of the cognitive 
tests and since only very limited use was made of SIB items, and in 
such a way that students with dubious responses would almost certainly 
have been eliminated by the procedure used. 
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3. Test Reliability * Reliability coefficients for the matched retest 
cases are shown in Table 4-8, both for grade 9 and for grade 12, 

Table 4-7, in columns 5-6, presents reliability coefficients for the 
grade 12 norms group, tested in 1960. All these results suggest that 
the tests on the whole have very satisfactory reliability coefficients 
in relation to test length. As a matter of fact there is some 
evidence, in the research results presented in Chapters 5, 6, and 7, 
that despite all efforts to get accurate estimates, some of the 
reliability coefficients reported in the present chapter are under- 
estimates of the true values to a very substantial extent. This 
phenonemon seems particularly prevalent in the case of the informa- 
tion scales. 

4. Reliability of Difference Scores . Reliability coefficients for 
differences between correlated scores tend to be low. But some of 
the TALENT tests turned out to have surprisingly high reliabilities 
for the differences between grade 9 scores and grade 12 scores. 

Reading Comprehension, Word Functions in Sentences, and some of the 
mathematics tests were among those having the highest reliabilities 
for difference scores. 

5. Reliability of Residual Scores . Residual twelfth-grade scores 
(after eliminating the component predictable from ninth-grade scores 
on the same test) are considerably more reliable than difference 
scores. Residual scores on almost all the tests turn out to have 
useful degrees of reliability. 

Recommendations on Methodological Ma tters 

This chapter devotes considerable attention to methodological matters, 
particularly in connection with the computation of reliability coefficients. 

A list of the decisions and conclusions reached follows. 



1. The kind of reliability coefficient that is best depends in part on 
the nature of the test (e.g., whether it is speeded or not, whether 
the items are all experimentally independent or not, and whether 
retesting with the same form after a short interval of time gives 
scores that are experimentally independent of the original ones). 
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2. The kind of reliability coefficient that is best also depends in part 
on the purpose for which it is to be used. In the case of the present 
study, reliability coefficients are needed for use in helping interpret 
the results obtained in a retest study in which the same forms of the 
same tests are used for retesting after a 3-year interval as were 
used originally. 

3. In view of the above purpose, the best kind of reliability coefficient 
to obtain for those tests that are essentially unspeeded is a split- 
half coefficient, adjusted by means of Angoff formula //16. 

4. Adjustment of reliability coefficients by means of the correction- 
for-range procedure whenever the group for which results are to be 
interpreted is not the one on which the reliability coefficients are 
based is strongly recommended. This recommendation is supported by 
the presentation of empirical data that show that the correction- 
for-range formula produces very accurate estimates. 

S ignificance of the Findings 

The results reported in this chapter have bearing on the research presented 
later in this report. In particular, the reliability of the various tests and 
derived scores (difference scores, etc.) is directly relevant in interpreting 
almost all of the research reported in subsequent chapters. 

This chapter, unlike the remaining ones, has been concerned primarily 
with the tests rather than with the students or the schools. However Chapter 5 
("Changes in Performance between Ninth and Twelfth Grades") and Chapter 6 ("The 
Organization of Mental Abilities") also, contain some material that may be 
viewed as providing new insights about the tests. But the alternative approach 
of regarding this material as primarily providing new insights about the 
students seems preferable — which is why that material is in Chapter 5 instead 
of here in Chapter 4. 









Chapter 5. GRANGES IN PERFORMANCE BETWEEN NINTH AND TWELFTH GRADES 



In this chapter we shall take a look at the changes in performance that 
occur between grades 9 and 12 in various areas. Among the questions to which 
we shall seek answers are the following. How much change has occurred? In 
what direction? In what areas? How much do boys and girls differ in these 
respects? Is the amount of growth correlated with the starting point (grade 9 
score, in this case)? Is it possible to distinguish empirically between 
measures of "aptitude" and measures of "achievement"? 

Basic Data . All data presented in this chapter are based on the data 
of Tables 4-8 and 4-9; thus, in effect, the data for each test are based 
on all students having both grade 9 and grade 12 scores for that test. 



Amount of Growth 



Table 5-1 shows the mean differences between grade 9 and grade 12 
scores, and the ratio of the mean difference to its standard deviation, to 
its standard error of measurement, and to the standard error of measurement 
of its raw score. The first of these three ratios is in columns 3-4, the 
second in columns 5-6, and the third in columns 7-8. 

It should be clearly understood that none of these three kinds of ratios 
is a critical ratio, since their denominators are not standard errors of 
means. They are standard deviations of observed raw scores or of raw score 
differences (either for the group of students in the case of columns 3-4, 
or for the probability distribution of a single typical student’s scores, 
taking error of measurement into account, in the case of the column 5-6 and 
column 7-8 values). There is no intention here of testing the differences 
between means for significance. It is quite unnecessary to do that formally 
since it is obvious from the magnitude of the gains relative to their standard 
deviations and from the size of the groups that all of the mean gains are 
significantly different from 0. 

The function of the ratios in Table 5-1 is to express mean gains in terms 
of a scale based on a standard of individual gains, in order to impart some 
degree of comparability to mean gains for different tests. In the column 3-4 
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TABLE 5-1. Analysis of mean differences between grade 9 and grade 12 raw scores 
(Based on matched retest cases, weighted by Weight Z) 
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(1) 


(2) 
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(4) 
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Information I 




















R-102 


Vocabulary I 


21 


2.60 


2.67 


.96 


.97 


1.05 


.98 


1.48 


1.38 


R-103 


Literature 


24 


4.33 


4.64 


1.27 


1.40 


1.53 


1.58 


2.16 


2.24 


R-104 


Music 


13 


.96 


.97 


.43 


.48 


.45 


.48 


.63 


. 64 


R-105 


Social Studies 


24 


3.00 


3.08 


.82 


1.00 


1.05 


1.03 


1.49 


1.45 


R-106 


Mathematics 


23 


4.31 


2.11 


.96 


.49 


1.51 


.77 


2.13 


1.09 


R-107 


Physical Science 


18 


1.58 


.53 


.55 


.18 


.66 


.20 


.93 


.28 


R-108 


Biological Science 


11 


1.20 


1.15 


.64 


.60 


.64 


.60 


.89 


. 80 


R-109 


Scientific Attitude 


10 


1.30 


1.30 


.70 


.72 


■ 72 


.72 


1.02 


1.01 


R-110 


Aeronautics and Space 


10 


1.33 


.88 


.69 


.48 


.69 


.48 


.96 


.64 


R-111 


Electricity and Electronics 


20 


2.69 


.70 


.80 


.23 


1.01 


.26 


1.43 


.37 


R-112 


Mechanics 


19 


2.42 


1.61 


.90 


.60 


1.00 


.60 


1.42 


.84 


R-113 


Farming 


12 


.96 


1.01 


.50 


.53 


.51 


.53 


.72 


.72 


R-114 


Home Economics 


21 


1.55 


1.95 


.57 


.71 


.57 


.71 


.73 


1.00 


R-115 


Sports 


14 


1.64 


1.31 


.74 


.62 


.82 


.62 


1.15 


.82 




Information II 




















R-131 


Art 


12 


1.37 


1.48 


.64 


.73 


.67 


.73 


.94 


1.01 


R-132 


Law 


9 


1.48 


1.39 


.84 


.78 


.89 


.82 


1.26 


1.15 


R-133 


Health 


9 


1.18 


1.22 


.61 


.70 


.72 


.79 


1.01 


1.11 


R-134 


Engineering 


6 


.49 


.54 


.38 


.40 


.39 


.40 


.55 


.54 


R-135 


Architecture 


6 


.58 


.52 


.39 


.36 


.39 


.36 


.55 


.50 


R-138 


Military 


7 


.96 


.75 


.67 


.53 


.67 


.53 


.91 


.71 


R-139 


Acct . , Bus . , Sales 


10 


1.57 


1.73 


.80 


.95 


.84 


1.01 


1.26 


1.42 


R-140 


Practical Knowledge 


4 


.47 


.40 


.48 


.45 


.51 


.45 


.71 


.61 


R-142 


Bible 


15 


1.24 


1.25 


.51 


.56 


.54 


.56 


.76 


.79 


R-145 


Hunting 


5 


.44 


. 13 


.37 


. 11 


.37 


.11 


.46 


.15 


R-146 


Fishing 


5 


.42 


.09 


.34 


.08 


.34 


.08 


.46 


.10 


R-147 


Outdoor Activities (other) 


9 


.75 


.70 


.42 


.39 


.43 


.39 


.61 


.52 


R-150 


Theater; Ballet 


8 


.97 


.92 


.63 


.63 


.63 


.63 


.87 


.82 


R-162 


Vocabulary II 


9 


1.44 


1.15 


.78 


.66 


.91 


.71 


1.29 


1.00 


R-212 


Memory for Words 


24 


2.22 


2.99 


.42 


.57 


.76 


1.08 


1.08 


1.52 


R-220 


Disguised Words 


30 


3.71 


4.00 


.58 


. 64 












English 




















R-231 


Spelling . 


16 


1.67 


1.93 


.66 


.79 


.72 


.85 


1.01 


1.21 


R-232 


Capitalization 


33 


1.07 


.77 


.24 


.18 


.49 


.43 


.69 


. 61 


R-233 


Punctuation 


27 


2.16 


2.35 


.59 


.71 


.73 


.87 


1.03 


1.24 


R-234 


English Usage 


25 


1.46 


1.35 


.45 


.44 


.50 


.49 


.71 


.69 


R-235 


Effective Expression 


12 


1.21 


1.11 


.48 


.51 


.64 


.60 


.90 


. 85 


R-240 


Word Functions 


24 


2.80 


2.92 


.61 


.65 


.92 


1.01 


1.30 


1.42 


R-250 


Reading Comprehension 


48 


6.31 


5.99 


.78 


.90 


1.50 


1.52 


2.12 


2.15 


R-260 


Creativity 


20 


3.28 


2.78 


.84 


.77 


1.23 


1.02 


1.74 


1.45 


R-270 


Mechanical Reasoning 


20 


2.40 


1.59 


.75 


.53 


1.07 


.60 


1.52 


.85 


R-281 


Visualization in 2 Dimensions 


24 


3.04 


2.44 


.54 


.48 










R-282 


Visualization in 3 Dimensions 


16 


1.85 


1.23 


.63 


.46 


.84 


.53 


1.19 


.75 


R-290 


Abstract Reasoning 


15 


1.40 


1.23 


.52 


.47 


.66 


.57 


.93 


.80 




Mathematics 




















R-311 


I. Arithmetic Reasoning 


16 


2.16 


1.53 


.74 


.56 


.88 


.61 


1.26 


.86 


R-312 


II. Intro, h.s. Math. 


24 


2.67 


.77 


.66 


.21 


1.03 


.28 


1.45 


.40 


R-333 


III. Adv. h.s. Math. 


14 


2.12 


1.15 


.66 


.42 


1.03 


.58 


1.46 


.82 


F-410 


Arithmetic Computation 


72 


9.01 


6.04 


.44 


.35 










F-420 


Table Reading 


72 


5.48 


4.44 


.40 


.50 










F-430 


Clerical Checking 


74 


11.46 


10.49 


.51 


.52 










F-440 


Object Inspection 


40 


4.83 


4.21 


.47 


.53 











a 

Based on the data of Tables 4-8 and 4-9. 



data the scale used is the standard deviation of all members of the group on 
which the table is based. In the column 7-8 data the scale is the hypothetical 
standard deviation among all the scores a single individual might obtain on 
the variable, taking due account of the fact that test scores are not completely 
reliable. In columns 5-6, the scale is the standard deviation of all the 
raw score differences between grade 9 and grade 12 scores that a single 
student might obtain. 

The column 3-4, 5-6, and 7-8 data are not variants of the same thing; 
they serve quite different functions. Columns 5-6, for example, tell us 
that on most tests the amount of gain in score that the average person 
achieves is quite sizable in comparison with its error of measurement. Columns 

3-4 and 7-8 give us some complementary information. 

In order to understand the significance of these data better, let us 
consider the results for just. one test, Reading Comprehension (R-250). 

Table 5-1, column 2, tells us that the average raw score gain between grades 
9 and 12 was 6 points for the girls. But what does this really mean? Is 6 

points a large gain? A trivial gain? To interpret it properly we should 

express it in terms of some sort of standard unit. For instance when the 
standard error of measurement is used as a unit the difference equals 1.5 

units (Table 5-1, column 6). Figure 5-1 shows this graphically. The left- 

hand curve represents what the hypothetical distribution of all the differences 
between an infinite number of grade 9 raw scores on Reading Comprehension and 
the corresponding grade 12 raw scores would be for a single typical student 
if the true difference were 0 and if due account were taken of errors of 
measurement by using the standard error of measurement of the difference as 
the standard deviation. The right-hand curve differs in that though it still 
represents a hypothetical distribution, its central point is the actual mean 
gain, which equals about 1.5 standard-error-of-measurement-of-the-dif f erence 
units. (In other words when expressed in terms of s tandard-error-of-measure- 
ment units, the original raw score difference, 6.0 points, is converted to 
1.5 points.) Note the fact that there is considerable separation between the 

two curves, suggesting a relative gain of considerable magnitude. 

Figure 5-2 shows the significance of the same raw score gain, 6 points 

(on R-250, for girls) in slightly different terms. In this graph the left- 

hand curve again represents what a hypothetical distribution of gains would 
look like if their mean were 0. In this case, however, instead of being the 
distribution of all of the score differences a single student hypothetically 
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Figures 5-1, 5-2, and 5-3 are all based on data from Tables 5-1 and 4- 



might get, it is a representation of what the distribution of difference scores 
for the entire sample of students would look like if the mean difference were 
0. But it isn't. The mean difference is actually 6.0 raw score points, 
which, when expressed in terms of standard-deviation-of-the-diff erence units, 
is converted to .9 such units. The right-hand curve in Figure 5-2 represents 
the distribution of differences, using their actual mean and standard deviation, 
6.0 and (from Table 4-9) 6.7 respectively, but reduced to standard deviation 
units so that they become respectively .9 (as indicated above) and 1.0. Again 
the important thing to note is that the two curves in Figure 5-2 are quite 
well separated, indicating that the mean difference is substantially different 
from 0. 

The column 7-8 data are rerhans even trore helpful in Riving us an idea 
of the meaning of the differences that have been found. Figure 5-3 corresponds 
to the column 8 data (for the same test, and the same group, as Figures 5-1 
and 5-2). The left-hand curve represents a probability distribution of the 
typical student's grade 9 score while the right-hand curve corresponds to the 
same student's grade 12 score, so that Figure 5-3 shows graphically the growth 
in reading ability manifested by the typical girl between grades 9 and 12. It 
is clear from the graph that there is real growth, not mere measurement error. 

Thus the data in columns 3-4, 5-6, and 7^8 of Table 5-1 tell us that on 
most tests the magnitude of individual gains tends to be substantial in rela- 
tion to the variation among them. In other worcls the average gain is not 
merely "statistically significant" (i.e., significantly different from 0); it 
is also large enough to be "important" or "meaningful." And that is what 
really counts in interpreting data of the sort under consideration (i.e., 
magnitude of differences) when the numbers of cases are large enough and the 
variables measured with sufficient precision that most differences turn out 
to be statistically significant. 

In past TALENT reports we have often pointed out that variation among the 
students in a grade is vastly greater than variation among grade means. And 
this is still true, of course. But it is encouraging ("refreshing" might be 
a better word) to be able for once to report changes between grades in terms 
which make it clear that growth does occur and that its magnitude is appreciabl 
The average student is learning — he expanding his mental capabilities. 
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Table 5-2, presents the mean differences between grades 9 and 12 
expressed in still another kind of unit — standard deviation of raw scores 
for grade 9 boys or girls (whichever is appropriate). This means that the 
gains are expressed in terms of a kind of standard score scale, with 
separate scales set up for boys and girls. The separate scaling for boys 
and girls has the advantage of making comparison among different tests a 
little more straightforward than it would be if an overall standard deviation 
had been used for this purpose. . It should be borne in mind, however, that 
it precludes use of these standard scores for comparisons between the sexes. 
Thus in using Table 5-2 to draw comparisons between boys and girls, columns 
1 and 2 are the ones to use. Columns 5 and 6 are intended primarily for 
comparisons among tests. 

Inspection of columns 5 and 6 reveals that for boys the largest gains 
are for Math III (R-333), information in math (R-106), literature (R-103), 
accounting, business, and sales (R-139), law (R-132), and the Creativity 
Test (R-260) . Girls show their largest gains in about the same fields, -i 
with the exception of Math Information (R-106), which drops considerably. 

For both sexes the gain in Abstract Reasoning is almost half a standard 
deviation. Areas in which gains are substantially higher than this seem 
to be mostly the ones in which course work and other activities are likely 
to be fairly extensive during high school. Creativity is perhaps the 
most conspicuous exception to this generalization. Gains on it are quite 
large even though it is not an area in which much formal instruction is 
likely in the typical high school. 

Other Findings 

Sex Differences in Score Gains . As has been suggested, both boys and 
girls show substantial growth in various kinds of knowledge and skill between 
grades 9 and 12. Table 5-3 shows (in terms of t-tests of the significance of 
the difference between boys' gains and girls' gains in various areas) that the 
two sexes show somewhat different patterns of mental growth. 

Boys seem to acquire significantly more information than girls in many 
areas, including mathematics, physical science, aeronautics and space, elec- 
tricity and electronics, mechanics, and sports; they also make significantly 
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TABLE S-2. Raw scoxe gains, grade 9 standard deviations, and ratio o£ former to latter 
(Baaed on Matched Retest Cases, Weighted by Weight Z)“ 
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Information 1 
















R-102 


Vocabulary I 


21 


2.60 


2.67 


3.80 


3.86 


.68 


.69 


R-103 


Literature 


24 


4.33 


4.64 


4.11 


3.80 


1.05 


1.22 


R-104 


Music 


13 


.96 


.97 


2.87 


2.82 


.33 


.34 


R-105 


Social Studies 


24 


3,00 


3.08 


5.29 


4.91 


.57 


.63 


R-106 


Mathematics 


23 


4.31 


2.11 


4.03 


3.61 


1.07 


.58 


R-107 


Physical Science 


18 


1.58 


.53 


3.69 


3.51 


.43 


.15 


R-108 


Biological Science 


11 


1.20 


1.15 


2.28 


2.14 


.53 


.54 


R-109 


Scientific Attitude 


10 


1.30 


1.30 


1.99 


1.86 


.65 


.70 


R-110 


Aeronautics and Space 


10 


1.33 


.88 


2.35 


1.64 


.57 


.54 


R-111 


Electricity and Electronics 


20 


2.69 


.70 


3.87 


2.54 


.70 


.28 


R-112 


Mechanics 


19 


2.42 


1.61 


3.28 


2.72 


.74 


.59 


R-113 


Farming 


12 


.96 


1.01 


2.28 


2.51 


.42 


.40 


R-114 


Home Economics 


21 


1.55 


1.95 


2.75 


3.29 


.56 


.59 


R-115 


Sports 


14 


1.64 


1.31 


2.94 


2.27 


.56 


.58 




Information 11 
















R-131 


Art 


12 


1.37 


1.48 


2.46 


2.44 


.56 


.61 


R-132 


Lav 


9 


1.48 


1.39 


1.78 


1.61 


.83 


.86 


R-133 


Health 


9 


1.18 


1.22 


2.04 


1.95 


.58 


.63 


R-134 


Engineering 


6 


.49 


.54 


1.24 


1.26 


.40 


.43 


R-135 


Architecture 


6 


.58 


.52 


1.25 


1.19 


.46 


.44 


R-138 


Military 


7 


.96 


.75 


1.38 


1.14 


.70 


. 66 


R-139 


Acct«» Bus«i Sales 


10 


1.57 


1.73 


1.79 


1.75 


.88 


.99 


R-140 


Practical Knowledge 


4 


.47 


.40 


1.04 


.90 


.45 


.44 


R-142 


Bible 


15 


1.24 


1.25 


3.22 


3.12 


.39 


.40 


R-145 


Hunting 


5 


.44 


.13 


1.20 


.89 


.37 


.15 


R-146 


Fishing 


5 


.42 


.09 


1.23 


.91 


,34 


.10 


R-147 


Outdoor Activities (other) 


9 


.75 


.70 


1.07 


1.81 


.40 


.39 


R-150 


Theater; Ballet 


8 


.97 


.92 


1.61 


1.61 


.60 


.57 


R-162 


Vocabulary 11 


9 


1.44 


1.15 


2.24 


2.14 


.64 


.54 


R-212 


Memory for Words 


24 


2.22 


2.99 


4.79 


5.18 


.46 


.58 


R-220 


Disguised Words 


30 


3.71 


4.00 


6.15 


6.35 


.60 


.63 




English 
















R-231 


Spelling 


16 


1.67 


1.93 


2.87 


2.74 


.58 


.70 


R-232 


Capitalization 


33 


1.07 


.77 


3.87 


3.40 


.28 


.23 


R-233 


Punctuation 


27 


2.16 


2. 35 


4.30 


4.13 


.50 


.57 


R-234 


English Usage 


25 


1.46 


1.35 


3.26 


3.04 


.45 


.44 


R-235 


Effective Expression 


12 


1.21 


1.11 


2.48 


2.15 


.49 


.52 


R-240 


Word Functions 


24 


2.80 


2.92 


4.82 


5.35 


.58 


.55 


R-250 


Reading Comprehension 


48 


6.31 


5.99 


10.56 


10.07 


.60 


.59 


R-260 


Creativity 


20 


3.28 


2.78 


3.77 


3.50 


.87 


.79 


R-270 


Mechanical Reasoning 


20 


2.40 


1.59 


3.93 


3.41 


.61 


.47 


R-281 


Visualization in 2 Dimensions 


24 


3.04 


2.44 


5.70 


5.51 


.53 


.44 


R-282 


Visualization in 3 Dimensions 


16 


1.85 


1.23 


3.21 


2.92 


.58 


.42 


R-290 


Abstract Reasoning 


15 


1.40 


1.23 


3.00 


2.96 


.47 


.42 




Mathematics 
















R-311 


1« Arithmetic Reasoning 


16 


2.16 


1.53 


3.38 


3.20 


.64 


.48 


R-312 


11« Intro, h.s. Math. 


24 


2.67 


,77 


4.06 


3.87 


.66 


.20 


R-333 


111. Adv. h.s. Math. 


14 


2.12 


1.15 


1.63 


1.51 


1.30 


.76 


F-410 


Arithmetic Computation 


72 


9.01 


6.04 


20.14 


16.21 


.45 


.37 


F-420 


Table Reading 


72 


5.48 


4.44 


10.10 


7.74 


.54 


.57 


F-430 


Clerical Checking 


74 


11.46 


10.49 


19.83 


17.73 


.58 


.59 


F-440 


Object Inspection 


40 


4.83 


4.21 


8.44 


7.30 


.57 


.58 



£1 

Based on the data of Table 4-9. 







TABLE S-'S* Analysis o£ sex differences in raw score gains 

(Based on matched retest cases, weighted by Weight Z)“ 



D 

( Mean 









raw acore 
gain ) 




t 






No. of 


M 


F 










item. 


(1) 


(2) 


(3) 


(4) 




Information I 












R-102 


Vocabulary I 


21 


2.60 


2.67 


- .07 


- .8 


R-103 


Literature 


24 


4.33 


4.64 


- .31 


- 2.8** 


R-104 


Music 


13 


.96 


.97 


- .01 


- .1 


R-105 


Social Studies 


24 


3.00 


3.08 


- .08 


- ,7 


R-106 


Mathematics 


23 


4.31 


2.11 


2.20 


15.2*** 


R-107 


Physical Science 


18 


1.58 


.53 


1.05 


14.9*** 


R-108 


Biological Science 


11 


1.20 


1.15 


.05 


.8 


R-109 


Scientific Attitude 


10 


1.30 


1.30 


.00 


.0 


R-110 


Aeronautics and Space 


10 


1.33 


.88 


.45 


7,2*** 


R-111 


Electricity and Electronics 


20 


2.69 


.70 


1.99 


18.9*** 


R-112 


Mechanics 


19 


2.42 


1.61 


.81 


9.2*** 


R-113 


Farming 


12 


.96 


1.01 


- .05 


- .8 


R-114 


Home Economics 


21 


1.55 


1,95 


- .40 


- 4.5*** 


R-115 


Sports 


14 


1.64 


1.31 


.33 


4.6*** 




Information II 












R-131 


Art 


12 


1.37 


1.48 


- .11 


- 1.5 


R-132 


Law 


9 


1.48 


1.39 


.09 


1.4 


R-133 


Health 


9 


1.18 


1.22 


- .04 


- .6 


R-134 


Engineering 


6 


.49 


.54 


- .05 


- 1.0 


R-135 


^Architecture 


6 


.58 


.52 


.06 


1.1 


R-138 


Military 


7 


.96 


.75 


.21 


4.1*** 


R-139 


Acct.p BuSep Sales 


10 


1.57 


1.73 


- .16 


- 2.3* 


R-140 


Practical Knowle^^ge 


4 


.47 


.40 


.07 


2.1* 


R-142 


Bible 


15 


1.24 


1.25 


- .01 


- .1 


R-145 


Hunting 


5 


,44 


.13 


.31 


- 7.3*** 


R-146 


Fishing 


5 


.42 


.09 


.33 


7. 7*** 


R-147 


Outdoor Activities (other) 


9 


.75 


.70 


.05 


.8 


R-150 


Theater; Ballet 


8 


.97 


.92 


.05 


.9 


R-162 


Vocabulary II 


9 


1.44 


1.15 


.29 


4.4*** 


R-212 


Memory for Words 


24 


2.22 


2.99 


- .77 


- 4.3*** 


R-220 


Disguised Words 


30 


3.71 


4.00 


- .29 


- 1.4 




English 












R-231 


Spelling 


16 


1.67 


1.93 


- .26 


- 3.1** 


R-232 


Capitalization 


33 


1.07 


.77 


.30 


2.0* 


R-233 


Punctuation 


27 


2.16 


2.35 


- .19 


- 1.6 


R-234 


English Usage 


25 


1.46 


1.35 


.11 


1.0 


R-235 


Effective Expression 


12 


1.21 


1.11 


.10 


1.3 


R-240 


Word Functions 


24 


2.80 


2.92 


- .12 


- .8 


R-250 


Reading Comprehension 


48 


6.31 


5.99 


.32 


1.3 


R-260 


Creativity 


20 


3.28 


2.78 


.50 


4.0*** 


R-270 


Mechanical Reasoning 


20 


2.40 


1.59 


.81 


7.8*** 


R-281 


Visualization in 2 Dimensions 


24 


3.04 


2.44 


.60 


3.4*** 


R-282 


Visualization in 3 Dimensions 


16 


1.85 


1.23 


.62 


6.6*** 


R-290 


Abstract Reasoning 


15 


1.40 


1.23 


.17 


2.7** 




Mathematics 












R-311 


I • Ar i thme tic Reasoning 


16 


2.16 


1.53 


.63 


6.6*** 


R-312 


II. Intro, h.s. Math. 


24 


2.67 


.77 


1.90 


14.7*** 


R-333 


III. Adv. h.s. Math. 


14 


2.12 


1.15 


.97 


9.6*** 


F-410 


Arithmetic Computation 


72 


9.01 


6.04 


2.97 


4.6*** 


F-420 


Table Reading 


72 


5.48 


4.44 


1.04 


2.7** 


F-430 


Clerical ' Checking 


74 


11.46 


10.49 


.97 


1.4 


F-440 


Object Inspection 


40 


4.83 


4.21 


.62 


2.0* 



Based on the data of Tables 4-8 and 4-9. 

*Signif leant at .05 level. 

**Significant at .01 level. 

***Signif leant at .001 level. 
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larger score gains than girls on several aptitude tests, including Creativity, 
Mechanical Reasoning, Visualization in Three Dimensions, and Abstract Reason- 
ing; and in all areas of mathematics achievement. 



are Literature Information, Memory for Words, Spelling, and of course Home 
Economics Information. 

For almost all of these variables the sex showing the larger average gain 
between grades 9 and 12 is also the one with the higher mean score in grade 9. 
(Literature Information is about the only exception.) 

Correlation between Grade 9 and Grade 12 Scores . Correlations between 

corresponding grade 9 and grade 12 variables were presented in Table 4-9. 

These same coefficients are shown in Table 5-4, where their values after 

correction for attenuation^ are also shown, in the columns headed rQ 

y IZ 



(columns 3-4). As was mentioned in Chapter 4, a few of the correlations 
between grade 9 and grade 12 after correction for attenuation exceed unity, 
suggesting that the reliability coefficients for these tests may be under- 
estimates. (These correlations in excess of unity occur only in the case of 
the Information Test — but for about half of its scales.) Nevertheless the 
fact that the correlations between information scores in grades 9 and 12 
corrected for attenuation tend to be generally so high, particularly in subjects 
not part of the regular high school curriculum, is significant. It underlines 
the fact that except in areas where formal instruction is received in different 
amounts by different students (e.g. , mathematics) the amount of information 
a student has been able to acquire and is sufficiently interested to acquire 
and retain is an excellent indicator of what his status in this respect will 
be three years later. Mathematics Information (R— 106) is among the informa- 
tion scales with the lowest corrected correlations. 

For most of the aptitude and achievement tests (other than the scales of 
the Information Test), the correlations corrected for attenuation are considerably 
lower than unity, their median being about .78. 



Some of the areas in which girls show significantly larger gains than boys 



00 00 



1 



Correlations corrected for attenuAt-inn ^ O o ♦“ T Q ♦- 1 _ • 
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TABLE 5-4. Correlation of grade 9 scores with corresponding grade 12 scores and with raw score gain 
(Based on matched retest cases, weighted by Weight Z)^ 











12 


*^9 

« 


12,, 
1 « 


’^9D 




^^9 D 

W « 






No. of 


M ' 


F 


M 


F 


M 


F 


M 


F 






items 


(1) 


(2) 


(3) 


(4) 


(5) 


(6) 


(7) (8) 




Information X 




















R-102 


Vocabulary I 


21 


.741 


.764 


.95 


1.00 


-.09 


.09 


-.25 3.17 


R-103 


Literature 


24 


.715 


.718 


.90 


.95 


,08 


.22 


.16 


.55 


R-104 


Music 


13 


.719 


.74L 


.97 


1.03 


.07 


.04 


.29 


.00* * 


R-105 


Social Studies 


24 


.745 


.797 


.88 


.99 


-.23 


-.08 


-.39 - 


.37 


R-106 


Mathematics 


23 


.716 


.686 


.87 


.86 


.34 


.34 


.51 


.53 


R-107 


Physical Science 


18 


.750 


.716 


.92 


.96 


,10 


.14 


.21 


.43 


R-108 


Biological Science 


11 • 


.638 


.615 


1.02 


1.08 


-.07 


.10 


,00* 


.00* 


R-109 


Scientific Attitude 


10 


.552 


.519 


.96 


1.01 


-.07 


-.01 


-.37 


.00* 


R-110 


Aeronautics and Space 


10 


.673 


.474 


1.02 


1.26 


.04 


.23 


.00* 


.00* 


R-lll 


Electricity and Electronics 


20 


.703 


.449 


.88 


.84 


.09 


.09 


.16 


.29 


R-112 


Mechanics 


19 


.648 


.575, 


.90 


1.05 


-.13 


.14 


-.34 


.00* 


R-113 


Farming 


12 


.628 


.696 


1.00 


1.06 


-.09 


-.06 


-.88 


.00* 


R-114 


Home Economics 


21 


.561 


.648 


1.24 


1.01 


.21 


-.02 


.00* 


.00* 


R-115 


Sports 


14 


.706 


.605 


.94 


1.10 


-.12 


.17 


-.35 


.00* 




Information IX 




















R-131 


Art 


12 


.629 


.665 


.95 


1.02 


-.01 


.06 


-.04 


.00* 


R-132 


Lav 


9 


.530 


.448 


.92 


.92 


-.02 


.05 


-.09 


.28 


R-133 


Heelth 


9 


.510 


.541 


.80 


.89 


-.23 


-.26 


-.53 - 


.72 


R-134 


Engineering 


6 


.414 


.412 


.94 


1.13 


-.10 


.03 


-.64 


.00* 


R-135 


Architecture 


6 


.378 


.356 


1,06 


1.28 


.12 


.15 


.00* 


.00* 


R-138 


Military 


7 


.477 


.338 


1.08 


1.42 


.08 


.19 


.00* 


.00* 


R-139 


Acct.t Bus. » Sales 


10 


.468 


.517 


.84 


.92 


.00 


.05 


.00 


.22 


R-140 


Practical Knowledge 


4 


.478 


.423 


.99 


1.40 


-.24 


-.13 


-.94 


.00* 


R-142 


Bible 


15 


. 737 


.761 


.97 


1.00 


.06 


.11 


.24 


.92 


R-145 


Hunting 


5 


.523 


.239 ' 


1.35 


.00* 


.19 


.20 


.00* 


.00* 


R-146 


Fishing 


5 


.538 


.235 


1.13 


6.70 


.15 


.18 


.00* 


.00* 


R-147 


Outdoor Activities (other) 


9 


.529 


.506 


.96 


1.13 


-.06 


.05 


-.37 


.00* 


R-150 


Theater; Ballet 


8 


.582 


.623 


1.04 


1.13 


.12 


.16 


.00* 


.00* 


R-162 


Vocabulary II 


9 


.634 


.620 


.87 


.95 


-.19 


-.23 


-.43 - 


.73 


R-212 


Memory for Words 


24 


.504 


.554 






-.19 


-.22 






R-220 


Disguised Words 


30 


.585 


.607 






-.28 


-.28 








English 




















R-231 


Spelling 


16 


.640 


.590 


.92 


.91 


.03 


-.10 


.08 - 


.31 


R-232 


Capitalization 


33 


. 337 


.305 


.40 


.35 


-.44 


-.42 


-.55 - 


.50 


R-233 


Punctuation 


27 


.660 


.688 


.85 


.87 


-.08 


-.10 


-.15 - 


.19 


R-234 


English Usage 


25 


.522 


.493 


.85 


.83 


-.05 


-.08 


-.15 - 


.23 


R-235 


Effective Expression 


12 


.451 


.474 


.66 


.76 


-.28 


-.16 


-.50 - 


.38 


R-240 


Word Functions 


24 


.615 


.667 


.74 


.78 


-.10 


-.18 


-.14 - 


.26 


R-250 


Reading Comprehension 


48 


.712 


.771 


.77 


.84 


-.26 


-.29 


-.32 - 


.38 


R-260 


Creativity 


20 


.549 


,537 


.70 


.74 


-.10 


-.09 


-.16 - 


.16 


R-270 


Mechanical Reasoning 


20 


.658 


.640 


.79 


.88 


-.24 


-.01 


-.37 - 


.02 


R-281 


Visualization in 2 Dimensions 


24 


.492 


.571 






-.54 


-. 46 






R-282 


Visualization in 3 Dimensions 


16 


.601 


. 592 


.78 


.85 


-.16 


-.07 


-.27 - 


.16 


R-290 


Abstract Reasoning 


15 


.568 


.601 


.78 


.82 


-.23 


-.15 


-.43 - 


.31 




Mathematics 




















R-311 


1. Arithmetic Reasoning 


16 


.650 


.679 


.86 


.94 


-.05 


.08 


-.11 


.22 


R-312 


11. Intro, h.s. Math- 


24 


.688 


.674 


.82 


.84 


.14 


.10 


.21 


.16 


R-333 


Ill. Adv. h.s. Math. 


14 


.229 


.152 


.58 


.49 


.12 


.07 


.36 


.26 


F-410 


Arithmetic Computation 


72 


.465 


.461 






-.52 


-.47 






F-420 


Table Reading 


72 


.155 


.241 






-.62 


-.70 






F-430 


Clerical Checking 


74 


.270 


.278 






-.68 


-.66 






F-440 


Object Inspection 


40 


.287 


.407 






-.58 


-.54 







^Based on the data of Tables 4-8 and 4-9. 

*Correlations corrected for attenuation are considered equal to 0 if either of the relevant reliability 
coefficients is 0 (or negative). 
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Correlation between Grade 9 Score and Raw Score Gain . Along with the 
correlations between grade 9 and grade 12 , Table 5—4 also shows the correlation 
between initial score (grade 9 score) and raw score gain (grade 12 score 
minus grade 9 score), both before and after correction for attenuation r^^ and 

2 . 

r^ respectively) . The correlations between initial score and gain tend 

to be close to zero before correction, and are often negative; and the ones that 
aren’t close to zero after correction for attenuation are almost certainly 
negative. Again a major exception is Mathematics Information (R-106) for which 
the correlation is not only positive but sizable (about .5 after correction 
for attenuation) . 

The fact that many of the correlations are negative is of course in line 
with expectation in view of the tendency noted in Chapter 3 for this to occur 
on a somewhat artif actual basis. 

Aptitude VS, Achievement 

Strictly as a convenience we have been using the label "aptitude test" 
to apply to almost all of the tests except Information, English, Mathematics 

( (especially Math II and III), and occasionally Reading Comprehension. Some 
of these latter measures (English and Mathematics in particular) have been 
referred to as achievement tests. Behind this use of the terms "aptitude" 
and "achievement," however, has been the recognition that the distinction is 
a shadowy one — and at best artificial. The results presented in the present 
chapter — particularly those under the heading "Correlation between Grade 9 and 
Grade 12 Scores" — point up the fact that no sharp distinction can be drawn, 
on an empirical basis, between those tests that function as "aptitude measures" 
and those that function as "achievement measures." This conclusion follows 

I 

[ 

I 

I ^The raw correlation before correction for attenuation — i.e., r^^^ — was obtained 

j by means of formula 3 in Chapter 3. 
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from the fact that most of the tests of the type that have traditionally been 
called aptitude measures (e.g.. Visualization in Three Dimensions, R-282) 
have lower correlations between grade 9 and grade 12 scores after correction 
for attenuation, than tests in which "achievement," as the term is commonly 
understood, is an important element— for instance such teachable areas as 
information about art. Instead of regarding some tests as always measures of 
an "aptitude" and others as always measures of some kind of "achievement it 
is probably better to base the choice of a term "aptitude test" or "achievement 
test" on how and for what purpose the test is being used. The same test may 
serve as an aptitude measure (to predict future achievement) or as an achievement 
measure (to measure past achievement)— depending entirely on the context. 

This problem of whether it is ever possible to draw any sharp distinction 
between aptitude measures and achievement measures is considered further in 
Chfc .ters 7 and 8, where additional empirical data bearing on the question are 
presented. 



Chapter 6. THE ORGANIZATION OF MENTAL ABILITIES 



In the last chapter we looked at the relationship between grade 9 scores 
and grade 12 scores on the same test . In the present chapter we expand the 
area of inquiry to include interrelations among different tests , as well. 

OBTAINING CONSISTENT CORRELATION MATRICES 



Procedural Sequence 

In order to investigate the problem of the organization of mental abilities, 

two correlation matrices were needed (one for males and one for females), 

involving as many as possible of the variables for both grade 9 and grade 12. 

This necessitated combining the groups taking retest batteries A, B, C, D, 

E, and F into one "super-group" — with all the incomplete data that that 
1 

implies. The method used was that described in Chapter 3 under the heading 
"Correcting Correlation Coefficients for Missing Data." To reduce the magni- 
tude of the problems created by missing data, each case was weighted by 
retest weight Z (also described in Chapter 3). This was done to help make the 
initial groups to be combined in a matrix (i.e., the groups taking the six 
retest batteries) as similar as possible, by making them exactly equivalent 

with respect to one very important dimension, score on the Abstract Reasoning 
Test (R-290). The purposes of this weighting were (1) to reduce to a minimum 

the likelihood that major adjustments in the correlations would be necessary 
in order to get consistent matrices, and (2) to make the correlation matrices 
as close as possible to what they would have been if complete cases had been 
available on which to base them. 

Ninety-nine variables were selected for inclusion in the matrices: 

49 aptitude and achievement test scores for grade 9, the same 49 for grade 12, 



1 

The necessity of dividing the TALENT battery into "retest batteries" organized 
in such a way that no participant in the retest study took more than half the 
original battery on the second occasion is discussed in Chapter 2. 
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and socioeconomic index. ^ These 99 variables are identified in Tables 6-la 
and 6-lb. Table 6-la shows Matrix lA, the final correlation matrix for the 
males, and Table 6-lb shows Matrix IB, the final correlation matrix for the 
females. 

The first stage in obtaining the final consistent matrices shown in 
Tables 6-la and 6-lb was to obtain a matrix in which each correlation was 
based on all cases having complete data for the pair of variables correlated. 

In this initial matrix, cases were weighted by Retest Weight Z. These 
matrices based on complete pairs are shown in Appendix I (Table I-l for males 
and Table 1-2 for females). (They are called pseudo-matrices as a reminder 
that the correlation coefficients throughout are neither based on the same 
set of cases nor adjusted to correct for this.) 

The second stage was to correct the individual correlation coefficients 
for missing data. (The resulting matrices, which are referred to in this 
chapter as the "intermediate matrices," are not reproduced in this report, 
since they serve no function themselves, except as a transition step from 
the initial matrices of Appendix I to the final consistent matrices of 
Tables 6-la and 6- lb.) 

The third stage was to test the intermediate matrices for internal 
consistency, and since both the one for males and the one for females turned 
out to be slightly inconsistent (having at least one negative eigenvalue), 
to go through the procedure for adjusting them to make them consistent. 

The resulting matrices are the final ones, shown in Tables 6-la and 6-lb. 

Evidence Concerning Effectiveness of Procedure 

The various methodological innovations used to obtain these final 
matrices appear to have worked well. The end-products, two internally 
consistent matrices, were achieved with only very slight adjustments, after 
the initial correction had been made for missing data. In the intermediate 

I ' 

matrices, only two of the 99 eigenvalues for the males and one for the j: 



^The socioeconomic index (designated P*801) is described in Appendix E. 



iililliiiiiiiliiiiilllilliiiiiiilililii^^ 






f6mal6s wer6 fi6gativ6, and 6V6n thosa wara numarically small j and of coursa 
aftar tha adjustmant to maka tha matricas consistant avan thasa faw nagativa 
aiganvaluas wsra aliminatad. Tha fact that tha nagativa aiganvaluas wara 
so faw and so closa to zaro is avidanca that tha initial corraction-f or- 
missing-data procadura producas intarmadiata matricas which, avan though 
thay may ba slightly inconsistant , do tand to ba consistant or naarly so. 

Datails about tha aiganvaluas ara summarizad in Tabla 6-2. 

Furthermora tha diffarancas batwaan tha intarmadiata matricas and tha 
final consistant matricas wara nagligibla, tha largast such diffaranca for 
tha malas baing only .0148. (This was for tha corralation batwaan grada 12 
sco 7 iTas on R-250 and R-281.) Tha fact that thasa diffarancas wara so vary 
small damonstratas that tha procadura for adjusting an inconsistant matrix 
to maka it consistant succaads in accomplishing this with only minimal changas 
in tha corralations. 

Comparison of tha initial matricas (in Appandix I) with tha final 
matricas (in Tabla 6-1) ravaals that thasa diffarancas too ara quita small. 

Again considaring only tha data for malas (sinca this was tha sat for which 
tha intarmadiata matrix had tha largast nagativa aiganvalua), tha largast 
diffaranca batwaan corrasponding corralation coafficiants in Tabla I-l and 
Tabla 6-la is only .0598 (raprasanting an incraasa from .2878 to .3476 in 
tha coaff iciapt of corralation batwaan grade 12 scores for R-232 and F-430). 

The fact that the changes are so small, and also the fact that even the 
initial matrices were almost consistent (as shown in Table 6-2 by the fact 
that for each of these matrices only one small eigenvalue was negative) 
are, regarded as evidence that the use of weight Z was effective in reducing to 
a minimum whatever distortions there might be in the original matrices (the 
ones shown in Appendix I) that are due to missing data. 

The fact that a coordinated set of methodological innovations was used 
successfully for two separate matrices (males and females) provides considerable 
empirical evidence of the effectiveness of these procedures, which produced 
almost all of the data on which the present chapter is based. 



o 







f 



6-4 



Variable 

R-102 63 Vocab. I 
R-103 63 Literature 
R-104 63 Music 
R^105 63 Soc. Stud. 



5. R-106 63 Math 

6. R-107 63 Phys 
R-108 63 Bio. 



7. 

8. 

9. 

10 . 

11. 

12 . 

13. 



Sci. 
Sci. 

R-109 63 Sclent. Att 
R-110 63 Aero-Space 
R-III 63 Electronic 
R-112 63 Mechanice 
R-113 63 Farming 
R-114 63 Home Ec. 



14. R-115 63 Sporte 

15. R-131 63 Art 



16. 

17. 

18. 

19. 

20 . 



R-132 63 Lew 
R-133 63 Health 
R-134 63 Engin. 
R-135 63 Arch. 

R-138 63 Military 

21. R-I39 63 Acct^Buei. 

22. R-140 63 Prec.Knowl 

23. R-142 63 Bible 
R-145 63 Hunting 
R-146 63 Fiahing 
R-147 63 Outdoor 
R-150 63 Theater 

26. R-162 63 Vocab. II 
“TfT: R-212 63 Mem 4 Worda 
R-220 63 Disg. Wde. 
R-231 63 Spelling 
r- 232 63 Capital. 
R-233 63 Punct. 
R-234 63 Eng. Usage 
#135. R-235 63 Eff. Exp. 
■ R-240 63 Word.Funct 



24. 

25. 

26. 
27. 



30. 



:rn". 



32. 

33. 

34. 

35. 

'TT. 



37. R-250 63 Rdg. Compr 



38. 

39. 

40. 




58. 

59. 

60 . 

61 . 

62. 

63. 



r- 260 63 Creativity 
R-270 63 Mech.Reaa 
R-281 63 Vis. 2 Dim 

41. R-282 63 Vis. 3 Dim 

42. R-290 63 Abat.Reaa 
R-311 63 Arith.Reaa 
R-312 63 Xnt.HSMath 

45. R-333 63 Adv.HSMath 
bl F-410 63 Arith.Comp 
F-420 63 Table Head 
F-430 63 cur. Check 
49. F-440 63 Obi.Inap. 
3t). R-102 60 Vocab. I 
R-103 60 Literature 

52. R-104 60 MUaic 

53. R-105 60 Soc. Stud. 

54. R-106 60 Math 
R-107 60 Phya. Sci. 

56. R.-108 60 Bio. Sci. 

57. R-109 60 Scient.Att 
R-110 60 Aero-Space 
R-111 60 Electronic 
R-112 60 Mechanica 
R-113 60 Farming 
R-114 60 Home Ec. 
R-115 60 Sporte 

^ 64. R-131 60 Art 
e 65. R-132 60 Law 

R-133 60 Health 
67. R-134 60 Engin. 

66. R-135 60 Arch. 

R-138 60 Military 

70. R-139 60 Acct»Buai. 

71. R-140 60 Prec.Knowl 

72. R-142 60 iible 
R-145 60 Hunting 
R-146 60 Fiahing 
R-147 60 Outdoor 
R-150 60 Theater 

77. R-162 60 Vocab. II 
VT* R-212 60 Mem. Worda 
79. R-220 60 Diag. Wda. 
R-231 60 Spelling 

81. R-232 60 Capital. 

82 . 'R-233 60 Punct. 

03. R-234 60 Eng. Uaage 

#|B4. R-235 60 Eff. Exp. 

* 85. R-240 60 Word.Funct 

86. R-250 60 Rdg. Compr 

87. R-260 60 Creativity 

88. R-270 60 Mech.Reaa 
R-281 60 Vis. 2 Dim 
R-282 60 Via. 3 Dim 
r- 290 60 Abet. Reas 



73. 

74. 

75. 

76. 



89. 

90. 

91. 



JB Aifsr. R-311 60 Arith.Reaa 



93. R-312 60 Int.HSMath 

94. R-333 60 Adv.HSMath 
W. F-410 60 Arith.Comp 

96. F-420 60 Table 1^**8 

97. F-430 60 Cler. Check 

98. F-440 60 Obj.Inap. 

99. F*801 60 Socioecon. 



ERIC 



.6598 
.5838 
• 6220 
.5643 

• 5072 
.5657 
.5399 

• 5587 

• 4939 
.4293 
.4875 

• 5700 

• 5103 
.5600 

• 4487 
.35LL 
.4296 
.4751 

• 4919 

• 4797 

• 1635 
.2453 

• 5524 

• 5302 
.6492 

• 3771 
.5226 
.4098 

• 3159 
.5305 
.4685 
.4101 

• 4448 

.6888 

• 5235 

• 5261 

• 3082 

• 3653 
.4265 

• 551) 
.5312 
.1466 
.2977 

• 2084 

• 1881 
.1549 
.3725 



TABLE 



Consistent matrix of correlation among 99 variables (aptitude 
Information! achievement, socioeconomic index) 







Matrix 


U. Ba 


1 


2 


3 


4 




. 73ol 


.6598 


. 7420 


7381 




.6888 


. 74 78 


6598 


.6888 




.6277 


7420 


. 7478 


.6277 




7149 


• 6731 


.6058 


.6590 


7536 


.6953 


.0123 


.7 32? 


6494 


• 6062 


.5049 


.6225 


6103 


.5430 


.4850 


.54 )2 


6951 


.6057 


. 5600 


.6?4i 


,6506 


.5103 


.5966 


.5508 


5845 


.3949 


. 390 3 


.4548 


,4978 


.41 75 


.3)81 


,♦464 7 


,4989 


.4383 


.4456 


.6359 


.5537 


.5610 


.5061 


,♦6019 


.6229 


.6604 


.6158 


i-6043 


.6127 


• 6091 


.5333 


.6572 


.6207 


.5859 


.4899 


• 6000 


.5174 


.44 98 


. 3841 


.4906 


.5388 


.5220 


.4744 


.5105 


.4789 


.5199 


.4827 


.4791 


.6047 


.5191 


.4 730 


.557 1 


.5082 


.4872 


.4112 


.5108 


.5774 


.6258 


.5258 


• 6035 


. 1605 


.0807 


• 07C1 


. 1056 


.3595 


.2526 


.2009 


.26)6 


.6145 


.5335 


.4o76 


.5568 


• 6344 


• 603d 


.5815 


.5819 


.7182 


.6305 


.589 3 


.6711 


.3893 


. 3969 


.3)09 


• 3637 


.5062 


.4951 


• 4 740 


. 3970 


.4133 


.4729 


. 3842 


.4460 


• 3048 


. 3227 


.2550 


.3392 


.5300 


.53 73 


.4 722 


.5291 


.4607 


• 4793 


• 4306 


.4520 


.4799 


.4462 


• 3883 


.4164 


• 5351 


.54A1 


.5055 


• 5125 


• 7117 


.6841 


.6149 


.6972 


.6143 


.5499 


.5365 


.5392 


.5303 


.4414 


.4247 


.4574 


• 4046 


• 3351 


.3141 


.35)2 


.4438 


. 3793 


. 3529 


. 3742 


• 5018 


.4463 


.4140 


.4610 


.5744 


.4962 


.4082 


.5194 


.5827 


.5320 


.4665 


• 5794 


• 4926 


.5117 


.4561 


.4760 


.2918 


.2373 


. 1886 


.3176 


• 2832 


• 2507 


• 2376 


.2752 


• 3340 


.3293 


.2761 


.3088 


.2761 


.2224 


• 1933 


,2283 


• 7378 


• 6493 


.6199 


.6229 


• 6055 


.7052 


.6150 


• 5760 


.5537 


• 5746 


. 709 7 


.4831 



Based on males (matched cases only) ' 



.6777 

• 5683 
.5915 
.5364 
.4376 
.5168 
.4320 
.4016 

• 4305 
.3808 



.5882 

• 5218 
.5177 
.4635 
.3984 
.5173 
.4324 

• 4238 
.3711 

• 3992 



. 7376 
.5425 

• 598/ 
.5442 

• 4420 
.5000 
.4443 
.4217 

• 4376 
. 3725 



5 



. /149 
.0/U 

.6056 

.6590 



. 7747 
.55 34 
.5212 
.5908 
.6126 
. 3930 
.3295 

• 4070 
.5270 
.537 7 

• 5064 

• 5145 
.3902 
.4652 
.4360 
.4978 
. 3995 
.5250 
.0700 
.2270 
.5182 

• 5164 
.5732 
.3979 

• 5000 
.4 746 
.2866 
.60 39 
.4682 
.4128 
.6348 
.6155 
.572 7 
.4973 
.4042 
.4451 
.5575 
.6149 

• 8081 
. 7538 
.3420 
.2760 

• 3336 
.2076 
.6478 

• 54 73 
.5213 

• 6369 
.7109 

• 6353 
.5330 
.4235 
.5160 
.5112 
.4467 
.3927 
.390 7 



.4868 


• 4899 


.5095 


.5136 


• 5845 


• 5616 


.5181 


.4869 


.5109 


.4739 


• 4915 


.4804 


.5396 


.5039 


• 5054 


.5275 


• 3828 


.3723 


.3941 


• 3904 


.3570 


.3360 


. 32 73 


.3101 


.4559 


.4611 


• 4136 


.4100 


• 4656 


• 4402 


.4438 


.4699 


• 45)1 


.4565 


.4522 


.4365 


.5549 


.4839 


• 4903 


.4594 


.0896 


• 0362 


.1263 


.0643 


.1746 


.1873 


.1750 • 


.1615 


• 4926 


• 4 707 


.4672 


.5035 


.5395 


• 5 )04 


.4513 


• A690 


.5989 


.5839 


.5523 


.5891 


.3820 


.3711 


. 3674 


.4106 


• 5230 


.49 77 


.4449 


• 5124 


.4239 


.3998 


.3902 . 


.4567 


.2941 


• 2934 


.3262 


.3106 


• 4968 


• 4671 


.4948' 


.5911 


• 4225 


.4121 


.4209 


• 4442 


. 3796 


• 3415 


.3664 


.3918 


.4724 


• 4324 


• 4386 


.5798 


.6665 


.6060 


• 6442 


.6418 


.4638 


.4467 


.43 70 


• 4856 


.3979 


.4080 


.4251 


• 5017 


• 2502 


• 2392 


.2580 


.3367 


.3116 


.3182 


.3139 


• 4199 


.3585 


. 3731 


.3883 


.5009 


• 4817 


.4489 


.5135 


.6233 


• 5342 


.4 758 


.5104 


.6776 


.1318 


. 1644 


.1431 


• 1948 


.2530 


.2681 


.3086 


• 3228 


.1787 


.1724 


• 2041 


.2160 


.1961 


.2052 


.1775 


.2294 


.17/7 


. 1431 


• 1447 


.1803 


• 3648 


. 3925 


.2831 


.4053 



. 7536 
.695 3 
• 6123 
. 7327 
. 7747 



• 656 3 
.5455 
.6906 
. 7326 
.5064 
.4246 
.4719 
.4938 
.5769 
.5641 
.5879 
.5128 
.4867 
.4498 
.5084 
.4113 

• 5991 
. 1575 
.2690 

• 5300 
.5533 
.6209 
.3667 
.4662 
.4214 
.2876 
.5230 
.4331 

• 4169 

• 5692 
.6653 
.5852 
.5525 
.4120 

• 4712 
.5257 
.5585 
.6356 
.5645 

• 2849 

• 2713 
.3202 
.2529 
.6771 
.5587 
.5041 
.6620 
.6197 
.7425 
.5758 
.4421 
.5714 
.5929 
.4834 

• 4427 
.4126 
.4362 
.5115 
.4832 
.5378 
.4224 
.3173 

• 3861 
.4446 
.4326 
.4563 
.1605 
.2093 
.5017< 
.4621 
.5820 
.3745 
.4813 
.3925 
.2913 
.5323 
.4292 
.3646 
.4798 

• 6398 
.4847 
.5376 
.3081 
.4021 
.4597 

• 5718 

• 5661 
.1701 

• 3001 
. 1855 
. 1855 
.1772 
.3480 



.6494 
• 606? 
.5049 
.6225 
.5534 
.6563 



.4968 

.5606 

• 5 5 1 8 

.4910 
.4 738 
.4477 
.3893 

• 5366 
.5164 

• 5303 
.4333 
.4279 
.3531 
.4460 
. 3 722 
.5326 
.2622 
. 3333 
.4569 
.4388 
.5357 
.2954 
. 3493 
.3335 
.2350 
. 3975 
. 362 1 

• 3667 

• 3957 
.6209 
.5067 

• 4598 
.3265 
.3834 
.4113 
.4266 
.4501 

• 3795 
. 1954 
.1506 

• 2067 

• 1735 
.5654 
.4844 
.4000 

• 5471 

• 4595 

• 5600 
.6347 
.3 764 
.4807 
.4683 
.4404 

• 4 708 

• 3648 
.3204 
.4303 
.4060 

• 4508 
.3474 

• 2 744 
.2910 

• 3464 
.3675 

• 4257 

• 2442 

• 2690 

• 4 199 

• 3643 
.4570 

• 2 787 

• 3707 

• 2560 
.2191 
. 3894 

• 3651 

• 2956 

• 3649 

• 5316 

• 4102 

• 4377 

• 2022 

• 3000 

• 3367 

• 4268 

• 3940 
.1354 
.1795 
.1144 

• 0981 
. I 194 
.2241 



8 


9 


10 


11 


1 


.6103 


.6951 


• 650o 


• 5845 


.49/8. 


.!>4)0 


.6057 


.5103 


• )949 


• <tl / •» ' 


.4850 


.5600 


.5066 


• 3903 


.3381 1 


.54)2 


.6243 


.5508 


• 4548 


.^647 j 


.5212 


.5908 


.6126 


• 3930 


• )?^5 i 


.5455 


• 6906 


• 7326 


.5064 


•4246 1 


• 4968 


• 5606 


• 5518 


• 4910 


.47)8 




.5077 


.472 1 


• 4403 


.)5/? 1 


.5077 




.644 3 


.5493 


.40o;) 1 


• 4 721 


.6443 




• 6251 


.41W0 i 


.44(^3 


.5493 


• 6251 




.4922 1 


.3572 


.4000 


.40 70 


.4922 




.)970 


.44 79 


.^589 


• 4288 


.3471 ^ 


• 4391 


.4559 


.3381 


.3071 


.3U) 1 


.4719 


.5552 


• 452 1 


.3819 


. ) )6B 


.4890 


.5574 


.4 7^9 


.4416 


.3976 


.4328 


• 4878 


• 4803 


.4251 


.^551 { 


. 3707 


• 4846 


.4935 


.5094 


.^♦250 1 


.3552 


• 4624 


.4247 


. 3477 


.3054 ) 


• 3027 


.4477 


.3612 


.2781 


.1974 I 


.4705 


.5194 


.4599 


• 4207 


.3599 f 


.3284 


.3937 


.35)9 


• 3596 


.3250 1 


.4312 


.4803 


• 4129 


. 2738 


.3787 : 


.0 756 


.1791 


.2612 


• 3522 


.3624 : 


. 1979 


.?952 


.2864 


• 3658 


. 3504 


.4336 


.5056 


.4935 


.5290 


• 4 1 6 1 


.4377 


.5463 


.4316 


• 3679 


.39)5 


.4872 


.5 770 


• 4846 


.4656 


.4229 


.25 78 


.2355 


.2759 


• 1603 


.2057 


.3643 


• 3648 


.364 5 


.2250 


• IB60 


.3223 


.2692 


.2176 


. 1416 


.2477 ‘ 


.2720 


.2144 


. 1961 


. 1837 


• 2)46 1 


• 39)8 


.3658 


• 3548 


• 2468 


.2656 , 


. 3436 


. 3737 


.3390 


• 3231 


.307) i 


.3760 


.3268 


.3052 


• 2896 


.2770 j 


.4348 


.4204 


• 3989 


• 2430 


.2947 ! 


.590) 


.5979 


• 5263 


• 4649 


.4925 t 


.4884 


.5580 


.5865 


• 4936 


•4040 ; 


.4876 


.5740 


.5799 


.5546 


.4)20 1 


.3585 


.4026 


.4111 


• 3960 


.2610 1 


.4022 


• 4634 


• 4650 


• 4413 


.2931 


.4205 


.4313 


• 4487 


• 3686 


.2998 i 


.4808 


• 4082 


.4635 


• 4085 


.3359 


.4303 


• 4306 


.4795 


• 3232 


.2435 


.3835 


• 4336 


• 4096 


• 2035 


.1952 


.2380 


.1547 


.2063 


• 1809 


.2422 


.2449 


• 2245 


.2332 


• 1992 


.1625 


.2472 


• 2307 


• 2481 


.1845 


.1861 


.2640 


• 2852 


• 2576 


• 2827 


.1743 


.5224 


.6269 


.6014 


.4839 


. 3778 


.4180 


.5183 


• 4384 


.2795 


.2639 


.3927 


• 4746 


.4216 


• 3006 


•2429 j 


.48 74 


.5608 


.5139 


. 3720 


.3302 


.4342 


• 5018 


.4933 


. 3309 


• 2568 ;■ 


.4482 


• 5639 


• 6137 


.3956 


.3300 1 


.4181 


• 5140 


.4901 


.4357 


.3942 1 


.5444 


.4132 


.3946 


• 3453 


.2824 j 


.4152 


.6617 


.5685 


• 4331 


. 211 ^ 


.4018 


.5460 


• 7013 


• 4872 


.2883 


.3951 


.5133 


.5844 


• 6427 


.3881 


.3675 


.4206 


• 4356 


• 4401 


• 6200 


.3206 


• 3677 


• 4048 


. 3528 


.2717 


.373 1 


.3977 


• 300 5 


• 2312 


• 2287 


.4037 


.4808 


.4502 


• 3456 


• 2552 


.4054 


.4760 


• 4225 


• 3247 


• 2368 


.39 74 


.4785 


• 4516 


• 3440 


.2960 


.3216 


.4237 


• 4460 


• 3853 


.2690 


.2316 


.3128 


• 2947 


• 2196 


.1767 


.3114 


. 3996 


• 3393 


• 2449 


• 1656 


.3558 


.4043 


• 4169 


• 3255 


• 2368 


.3566 


• 4058 


• 3863 


. 3255 


.2414 


.3466 


.3980 


• 3556 


.2573 


.3123 j 


.llCl 


.1542 


• 1769 


• 2913 


.3127 


.1526 


• 2355 


• 2135 


• 2419 


.2373 


.4237 


• 4639 


• 4711 


• 3996 


.2959 


.3864 


• 4730 


.3888 


.2921 


• 2307 


.4610 


.5360 


.5177 


• 4115 


• 3070 


.2410 


• 2684 


.26 75 


. 163? 


• 1908 


.3795 


.3884 


• 3728 


.2755 


.2576 


• 2745 


• 2794 


• 2541 


• 1509 


.2231 


.2209 


.2361 


• 2360 


.1959 


. 1900 


• 4213 


• 3903 


• 4249 


• 2881 


.2816 


.3583 


. 3 757 


• 3699 


• 2983 


• 2386 


.3540 


.2985 


.3044 


• 2531 


.2356 


.3635 


• 3658 


• 3735 


.2254 


• 2272 


• 5292 


.5789 


• 5149 


• 3927 


.3618 


• 3882 


• 4864 


.4833 


.3907 


.2748 


.4019 


• 5260 


• 6083 


• 5063 


.3392 


«2447 


.2904 


• 3153 


• 2475 


. 1979 


• 3012 


.3704 


• 4429 


• 3213 


.2004 


.3763 


.3765 


.3984 


• 2834 


.2227 


.4534 


.4477 


• 4773 


.3492 


• 2910 


.4343 


• 4147 


.4271 


• 2748 


• 2563 


.1271 


• 1318 


• 14 19 


• 0776 


• 0516 


.2274 


.2009 


• 2066 


• 1532 


• 1761 


.1678 


.1550 


.1419 


• 1011 


• 1264 


• 1510 


.1509 


.0945 


.04 75 


• 0984 


.1762 


.1532 


• 1232 


o 1262 


.0882 


.2683 


.3177 


.2989 


• 2162 


• 0698 









TABLE 6-la (continued) 



li 




16 


16 


17 


IB 


19 


20 


21 


22 


23 


24 


26 


Variable 


.4989 


.551/ 


.6229 


.6127 


.6207 


.5174 


• 6388 


.4789 


.6047 


.6082 


.*j7 74 


.1006 


.3696 


1. R-102 63 


• 4383 


.5610 


.6604 V 


.6091 


.6869 


• 4498 


.52^0 


.6199 


• 6191 


.4872 


.62*>h 


.08j7 


. 2626 


2. R-103 63 


.^4t>6 


.5061 


.6168 


.6333 


• 4899 


.3641 


.4744 


.4827 


.4730 


.4112 


.5268 


.0 701 


.2009 


3. R-104 63 


.4i‘?9 


.6019 


.6043 


• 6672 


.6000 


.4906 


• 6106 


• 4791 


.6671 


.6108 


• 6036 


.111^)6 


.2636 


4. R-I05 63 


.40/0 


.62 70 


.537? 


• 6064 


.6146 


.3902 


.4652 


.4360 


.4978 


. 3996 


• 6260 


.0 700 


.2270 


5. R-I06 63 


.4719 


.4938 


.6769 


.5641 


.5879 


.6123 


• 4867 


• 4498 


.6084 


.4113 




.1676 


.2690 


6. R-107 63 


.447/ 


.iH‘n 


.6366 


.5164 


• 6303 


.4333 


.4279 


.3631 


.4460 


.3722 


. 5326 


.2622 


. 3333 


7. R-I08 63 


.3970 


• 4391 


.4719 


• 4890 


.4328 
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• 2820 


• 1U4 


.1048 


.1067 


• 46;i4 


20. R-138 63 


^79 


.1037 


.1390 


.2684 


• 3012 


.4766 


.4035 


.3556 


.2474 


.2132 


.1616 


.2227 


.4780 


21. R-139 63 


i3a 


.2715 


.0903 


.2718 


.2668 


.4048 


.3547 


• 2858 


.2726 


.2521 


.0919 


. 1969 


^4184 


22. R-140 63 


IH3 


.1181 


.1316 


.2489 


.3522 


.4180 


• 3761 


.1165 


.2474 


.1226 


• 1454 


.0669 


.5385 


23. R-142 63 


^2 


.1915 


.0668 


.0565 


.0568 


.0506 


-.0115 


-.0036 


-.0211 


.0180 


.0784 


.0115 


• 1146 


24. R-l4S 63 


159 


.2481 


.0587 


.1155 


.1565 


• 2166 


.1443 


. 1845 


.1403 


.0764 


.0613 


.1112 


.1419 


25. R-146 63 




.4297 


.1816 


.3305 


.3247 


.4134 


.4001 


• 3310 


.2444 


. 1543 


.1289 


.2170 


.5312 


26# R-147 63 


>50 


• 3313 


.1679 


.2674 


.3234 


.3987 


.3837 


.3444 


.2655 


# 1684 


.2039 


. 1617 


.5821 


27. R-ISO 63 


13 


#3704 


.2185 


.1429 


.3059 


.5539 


.5084 


.1924 


.1157 


.1509 


.2156 


.2017 


.6336 


26. R-162 63 


^BO 


• 3323 


.1802 


.2924 


#3518 


• 3789 


.4241 


.3639 


• 2519 


.0814 


.2050 


.2235 


.3895 


29. R-212 63 


►6? 


.4067 


.3391 


.3278 


.4069 


.4629 


.5031 


#4226 


.1117 


.2360 


.4212 


.2578 


.5147 


30. R^220 63 


45 


• 2304 


.1206 


.1734 


.3057 


• 4141 


• 5140 


#42/0 


.3485 


.07)1 


.2540 


.1125 


.4332 


31. R-231 63 


106 


.3462 


.2311 


.3031 


.3336 


.1873 


.3588 


.2839 


.1350 


. 1803 


.3476 


.1760 


.3028 


32. R-232 63 


49 


.4205 


.2276 


.1587 


.4920 


.6106 


.6467 


.5449 


.1693 


• U19 


.2604 


.1736 


.5341 


33. R-233 63 


56 


.1408 


.1266 


.2326 


.3718 


.4904 


.4960 


.3946 


.1143 


.0905 


.2230 


.1063 


.4679 


34. R-»234 63 


47 


.3480 


.2256 


.3058 


.3893 


.4977 


.4445 


.15/7 


.3009 


#1749 


• 2370 


.1692 


.4254 


35. R-23S 63 


>42 


.4123 


.3098 


• 4407 


• 5053 


.5312 


.6553 


.6178 


.2991 


.2028 


.2721 


.2200 


.5216 


36. R-240 63 


90 


.5225 


.3620 


.4692 


.5335 


.6165 


.6235 


.5149 


.3596 


.2249 


.2980 


.2270 


.6317 


37. R-2S0 63 




• 5716 


.6001 


.4816 


.4814 


.4914 


• 492 0 


.4226 


.2558 


.1725 


.2519 


.2601 


.5504 


38. R-260 63 


16 




.5060 


.5885 


.5762 


.5192 


.4901 


• 4010 


.2703 


. 1652 


• 2154 


.3196 


.4705 


39. R-270 63 


iBi 


• 5060 




.5009 


• 4260 


• 24.38 


.2 795 


.2221 


.1770 


.1830 


.2353 


.3536 


.3005 


40. R~281 63 


>16 


• 5885 


.5009 




.5556 


.4203 


.4205 


.3592 


.2174 


• 2388 


.2077 


.3631 


.3795 


41. R-282 63 


14 


.5762 


.6200 


.5556 




.5359 


.5239 


.4236 


.3308 


.2326 


.2741 


.2988 


.4411 


42. R-290 63 


14 


.5192 


.2630 


.4203 


.5359 




.6825 


• 5464 


.3893 


« 12B3 


.1753 


.1616 


.5661 


43. R-311 63 


>20 


.4901 


.2795 


.4205 


.5239 


.6825 




. 7376 


.4015 


. 1464 


.2 :5 


.1726 


.5727 


44. R-312 63 


26 


.4010 


.2221 


.3592 


.4236 


.5484 


.7376 




.3021 


• 0887 


.1735 


. 1606 


.4830 


45. R-333 63 


58 


• 2703 


.1770 


.2174 


.3308 


.3893 


.4035 


.3021 




.29/2 


.2891 


.2201 


.2929 


46. F-410 63 


25 


.1652 


.1030 


#.2388 


.2326 


.1281 


.1464 


.0887 


.2972 




.4034 


.3516 


.1371 


47. F-420 63 


• 19 


.2154 


.2353 


.2077 


.2741 


.1753 


.2915 


.1735 


.2891 


.4034 




.3172 


.2365 


48. P-430 63 


lOi 


.3196 


.3536 


.3831 


.2988 


.1614 


.1726 


. 1406 


.2201 


.3516 


.3172 




.1745 


49. f-440 63 


04 


• 4705 


.3005 


.3795 


• 4411 


.5661 


.5727 


.4830 


• 2929 


.1371 


.2365 


.1765 




3 ■ m W## 

So . R -102 60 


22 


.3299 


.2151 


.3077 


.3569 


.4577 


.4844 


.4617 


.1981 


.1398 


.2211 


.1258 


.6806 


51. R-103 60 


25 


.3221 


.2316 


.2 796 


• 3286 


.3905 


.4311 


.3926 


.1923 


. 1199 


.2215 


.1231 


.6133 


52. R-iOA 60 


2 7 


.3694 


.2200 


.3248 


.4105 


.5440 


.5987 


.5083 


.3043 


.1168 


.2312 


.1056 


.7222 . 


S3. R-IOS 60 


09 


.3839 


.2006 


.3653 


.4315 


.5' 02 


.6506 


• 6206 


• 2643 


.1334 


ol9ll 


. 1266 


• 6450 


54. R-106 60 


7 3 


.4764 


.2 790 


• 3707 


.4236 


.5111 


.5631 


.4987 


.2494 


. 1436 


.2463 


.1636 


.6886 


55. R-107 60 


i3^ 


.1931 


.1906 


.3217 


.3395 


.4478 


.4586 


.4244 


.2148 


.0255 


.1252 


.1229 


.6236 


56. r-108 60 


33 


.3687 


.2019 


.2931 


.3518 


.4820 


.4^/72 


• 3786 


• 2191 


.0/34 


.1354 


.0929 


.5482 


57. R-109 60 


34 


.4411 


.2667 


.339i 


.3575 


.3992 


.4079 


.3986 


• 1608 


.1002 


.1498 


.1323 


.6324 


58. R-110 60 


25 


.4558 


.2676 


.3346 


• 3214 


.4339 


.4224 


• 3678 


. 1567 


.0926 


.1768 


.1119 


.5949 


59. R-111 60 


82 


.4509 


.2526 


.3225 


.3201 


.4273 


.3499 


.2866 


.2094 


.0846 


.1517 


.1303 


.6102 


60. R-112 60 


59 


.3590 


.1096 


.2080 


.2713 


.4076 


.3492 


.2905 


• 2443 


.0557 


.1134 


.0571 


.5228 


6l. R-113 60 


26 


• 3169 


.1003 


.2189 


.2413 


.3428 


.3148 


.2661 


• 1536 


.0985 


.1249 


.0918 


.4810 


62. 1-114 60 


58 


.2340 


.1723 


.1880 


.3212 


.4402 


.5040 


• 4526 


.3037 


al63l 


.2136 


.1361 


.5418 


63. R-llS 60 


72 


.3421 


.2393 


.2998 


.3417 


.4307 


.4345 


.3567 


.2389 


.1177 


.2181 


.1368 


.6256 


64. R-131 60 


14 


.2944 


.1666 


.2534 


.2948 


.4016 


.4263 


.3395 


• 2180 


.0737 


.1529 


.0682 


.5558 


65. R-132 60 


07 


.3121 


.1523 


.2358 


.1254 


.4174 


.4337 


.3650 


.2670 


.1232 


.2023 


. 1032 


.5980 


66. R-133 60 


>48 


.3459 


.1950 


.2432 


.2909 


.3855 


.3517 


• 2932 


• 2323 


.0604 


<1242 


.1167 


.5029 


67. R-136 60 


09 


.2167 


.1630 


.2137 


.2220 


.2790 


.2808 


• 2623 


.1504 


• 0914 


• me 


.0661 


.3954 


66. R-13S 60 


46 


.2416 


.1197 


.^,945 


.2316 


.3343 


.3406 


.2977 


.1622 


.0693 


.1455 


.0656 


.4579 


69. R-138 60 


63 


• 2951 


.1063 


.2528 


.3005 


.4553 


.4238 


.3524 


.2288 


• 1098 


.1706 


.0965 


.5505 


70. R-139 60 


66 


.2941 


.1006 


.2579 


.3207 


.4192 


.4027 


.3277 


#2452 


. 1612 


.1910 


.1803 


.5127 


71. R-140 60 


55 


.2907 


.1550 


.2508 


.3069 


.3963 


.3740 


.3253 


.2067 


.0875 


.1335 


.0535 


.5085 


72. R-142 60 


79 


.1464 


.0310 


.0926 


.0713 


.I33(i 


.0556 


• 0467 


.0930 


.0022 


.025/ 


.0569 


.1524 


73. R-145 60 


49 


.1589 


.0066 


.1113 


.1121 


.1720 


. 1565 


• 1176 


• 1006 


-.0240 


.0499 


.0663 


.2712 


74. R-146 60 


38 


• 3732 


.2117 


.2696 


.3337 


• 4283 


.4493 


.3622 


.2572 


.0969 


.1524 


.1701 


.5724 


75. R-147 60 


80 


.2867 


.1935 


.2196 


.2949 


.3808 


.3922 


.3386 


. 21^1 


. 1 169 


.1803 


.1007 


.5879 


76. R-150 60 


05 


.37/6 


.2288 


.3206 


.3634 


.5158 


.5098 


.4270 


.2647 


.1047 


.2236 


.1356 


.662/ 


77. R-162 60 


71 


.2537 


. 1869 


.2144 


.2903 


.3258 


.3792 


.3108 


.1797 


.0960 


.2007 


.0966 


.3913 


78. R-212 60 


03 


.3487 


.2238 


.2610 


• 3624 


.4153 


.4^/2 


.4016 


.2923 


.1628 


.2456 


.1797 


.5446 


79. R-220 60 


25 


.1810 


.1261 


.1804 


.2816 


.3544 


. ^506 


.4001 


.2885 


.1452 


.2515 


.1123 


.4617 


80. R-231 60 


28 


.2263 


.1372 


.1815 


.2669 


.4465 


.4707 


.3608 


.3161 


.1125 


.1511 


.1165 


.3972 


81. R-232 60 


8 7 


.1662 


.2503 


.3155 


.4348 


.5490 


.6073 


.5161 


.3493 


.12/9 


.2130 


.1185 


.5430 


82. R-233 60 


83 


.3376 


.1782 


.2437 


• 3438 


• 4530 


.4446 


• 392 1 


.2714 


.1223 


.1529 


.1659 


.4938 


83. R-234 60 


05 


.2712 


.1096 


• 2461 


.3311 


.3921 


• 3847 


.3223 


.2294 


.091 7 


.1273 


.1086 


.4215 


84. R-235 60 


97 


.3198 


.2330 


.2985 


• 3813 


• 4668 


.5680 


.5598 


.2713 


.1360 


.2250 


.1183 


.4876 


85. R-240 60 


22 


.4356 


.2699 


.3634 


.4599 


.5655 


.5919 


.5143 


.3064 


.1395 


.2721 


.1676 


.7164 


86. R-2S0 60 


08 


.4222 


.2817 


.3819 


.4097 


.4798 


.4498 


.1782 


.2086 


.1069 


.19/3 


.1668 


.5752 


87. R-260 60 


83 


.6548 


.6117 


.3217 


.4766 


.4642 


.4359 


.3973 


.1717 


• 1047 


.1605 


.2276 


.5144 


88. R-270 60 


15 


.3930 


.6 792 


.3896 


• 3458 


.2811 


• 2916 


.2416 


• 1998 


. 1277 


.1764 


,2553 


.2930 


89. R-281 60 


01 


• 4846 


.6070 


.5990 


.4578 


.3575 


. 3709 


• 3380 


.1213 


.0833 


.0901 


.2006 


.3601 


90. R-282 60 


07 


• 4582 


.3721 


.4339 


.5674 


.4985 


.5015 


• 4268 


.2576 


• 1243 


.1664 


.2166 


• 4266 


91. R-290 60 


75 


.4325 


.2 766 


.3918 


.4568 


.6508 


.6263 


.5436 


• 3064 


.1211 


.1821 


.1152 


.5845 


92. R-311 60 


15 


.4059 


.2916 


• 3865 


.4717 


.5718 


.6914 


• 6247 


.3357 


.1719 


.2207 


.1226 


.5592 


93. R-312 60 


93 


• 1328 


.0993 


.1472 


.1280 


.1541 


.2022 


.2256 


• 06 74 


.0645 


.0417 


.0361 


• 1749 


94. R-333 60 


36 


.1957 


.1691 


v 21 l 0 


• 2689 


.3500 


.3424 


• 2496 


.4782 


.1176 


.1704 


. 1636 


• 2949 


95. F-410 60 


65 


.1610 


.1658 


.1766 


• 1986 


.2382 


.2400 


.1749 


.2803 


• 1514 


.1562 


.1606 


.1656 


96. F-420 60 


61 


.1209 


.1156 


.1564 


.1948 


.2097 


.2722 


.2228 


.28/9 


.1764 


.2657 


,1731 


.2090 


<?7. F-430 60 


29 


.1516 


.1820 


.2022 


.1767 


.0973 


• 1408 


.0962 


.1372 


• 1 196 


• 1601 


.2756 


• 1235 


98. F-A40 60 


93 


.25C4 


.1827 


.2174 


• 2830 


. 3228 


.330. 


.3187 


.1301 


• 149L 


.1766 


.1266 


• 4127 


99 , p*801 60 
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TABLE 6-l« (continued) 





VarlabU 


51 


52 


53 


54 


55 


56 


57 


58 


59 


60 


61 


62 




"T. K-i04 63 Vocab. I 


• 6055 


.5537 


• 6598 


• 5838 


• 6220 


*5643 


.50 72 


.565 7 


• 5399 


.5587 


• 4939 


• 4293 




2. R«-103 63 lic«r»tur« 


.7052 


.5746 


.6777 


• 5683 


.5915 


• 5364 


.43 76 


• 5168 


• 4320 


• 4016 


.4365 


• 3808 




3* R-104, 63 Mu«ic 


«6l50 


• 7097 


• 5882 


• 5218 


• 5177 


.4635 


.3984 


.5173 


.4324 


• 4238 


• 3711 


.3992 




4. R-105 63 So<5. Stud, 


♦ 5760 


• 4831 


.7376 


.5425 


.5987 


• 5442 


• 4420 


.5000 


• 4443 


• 421/ 


.43 76 


. 3725 




5, R*^106 63 Math 


.5473 


.5213 


• 6369 


• 7109 


• 6353 


• 5330 


.42 35 


• 5160 


• 51 12 


• 4467 


• 3927 


• 190? 




6. R-X07 63 Phya, Sci* 


.5587 


• 5041 


• 6620 


• 6l9f 


• 7425 


.5758 


*4421 


• 5714 


• 5929 


• 4834 


• 4427 


• 4126 




7. R-108 63 Bio* Sci. 


• 4844 


• 4000 


• 5471 


• 4595 


• 5600 


• 6347 


. 3764 


.4807 


• 4 6 8 3 


• 4404 


• 4708 


• 3648 




8. R-109 63 Sclent. Att 


.4180 


.3927 


• 4874 


• 4342 


• 4482 


• 4181 


.5444 


• 4152 


.4018 


.3951 


• 36 75 


• 3206 




9. R*'110 63 Aero-Space 


.5183 


.4746 


• 5608 


.5018 


• 5639 


• 5140 


.4132 


• 661 7 


• 5460 


• 5133 


• 4206 


. 3677 




10* R-111 63 Electronic 


• 4384 


.4216 


• 5139 


•4933 


• 6137 


*4901 


*3946 


• 5685 


• 7013 


♦ 5844 


.4356 


.4048 


4A 


11. R-112 63 Mochanice 


.2795 


.3006 


.3720 


• 3309 


.3956 


.4357 


• 3453 


• 4331 


• 48 72 


.6427 


• 4401 


.3528 


1 


12. R-113 63 Farming 


.2639 


• 2429 


• 3302 


• 2568 


.1300 


• 3942 


.2024 


. 2774 


.2883 


• 3881 


• 6200 


.2717 




13. R-114 63 Home Ec. 


.3423 


• 3605 


.3574 


.3351 


• 3550 


.3687 


.2970 


• 3584 


• 3658 


• 3982 


.3433 


• 5566 


1 


14. R**115 63 Sporte 


• 4075 


.3973 


• 5104 


• 4163 


.3908 


• 3397 


.3360 


. 3774 


• 2514 


.2894 


.2899 


.2903 




15. R-131 63 Art 


.5829 


♦ 5151 


• 6080 


• 5062 


• 5093 


• 4815 


.4041 


• 4906 


.4 139 


.4261 


.3713 


• 3889 


1 


16. R-132 63 Uw 


• 4820 


• 4236 


• 5671 


• 4647 


• 4543 


.4778 


• 4074 


• 4627 


• 3841 


.4190 


.3983 


• 3318 


£ 


17. R-133 63 health 


.4637 


.4069 


.5146 


.4407 


.4758 


.4517 


• 3632 


• 415/ 


• 3896 


• 4039 


. 3724 


. 3346 


A 


18. R-*134 63 Eng in. 


• 3327 


.2872 


• 4331 


.3562 


• 3709 


.3695 


• 3164 


• 3426 


• 3465 


• 4124 


.3581 


.3289 


rf 


19. R-135 63 Arch. 


.4646 


•4213 


.4880 


• 4361 


.4219 


• 384 7 


.3190 


.4026 


.3509 


.3410 


• 3069 


• 2818 




20. R-138 63 Military 


.4777 


• 4095 


• 5150 


• 3810 


.3682 


.3833 


.3181 


.40/5 




• 3142 


• 2883 


.2424 




21. R-139 63 AcctfBuei. 


.4174 


• 3868 


.4974 


• 4318 


• 3937 


.3805 


• 3720 


• 3960 


• 3658 


• 3971 


.3515 


. 352 7 




22. R-140 63 Frac.Knovl 


.3514 


.3177 


• 4248 


• 3422 


• 3294 


• 3185 


.2927 


• 3040 


.2372 


.3107 


,2856 


.2712 




23* R-142 63 Bible 


.5291 


.4687 


• 5637 


• 4628 


• 4781 


.4386 


• 3765 


.4246 


• 3459 


.2971 


• 3715 


• 2899 




24. R-145 63 Hunting 


• 0 706 


• 0174 


• 0918 


•0641 


. 1064 


• 1915 


• 1175 


.1281 


.1033 


• 2554 


.2824 


.1625 




25. R-146 63 Fiahine 


.2262 


• 1558 


• 2487 


• 2198 


.2715 


.3538 


• 2212 


.2524 


.2006 


• 3403 


.3024 


• 2149 




26* R-147 63 Outdoor 


.4180 


' .3666 


• 4067 


• 4406 


• 4291 


.4586 


.3690 


• 4418 


• 3760 


• 4542 


.3646 


.3261 




27. R-150 63 Theater 


.5397 


.5209 


• 5326 


•4735 


• 4331 


.4455 


• 3846 


• 4 706 


• 3631 


.4039 


.3695 


• 3524 




26. R-162 63 Vocab. XI 


• 5074 


• 4685 


.5885 


.4977 


.5065 


• 4621 


.4200 


• 4586 


.4366 


.5072 


.4155 


• 3819 




R**212 63 Mem. Worda 


.3688 


.2853 


.3822 


• 3558 


.3479 


.3132 


.2804 


.2352 


• 2182 


.1991 


.2571 


• 1973 




30. R-220 63 Diag. Wda. 


• 4668 


• 4563 


.4331 


• 4240 


• 4237 


.3459 


. 3466 


• 3618 


• 3361 


.3545 


.2791 


.2679 


3 


3T. R-231 63 Spelling 


.4303 


• 3556 


• 4469 


• 4225 


.4126 


.3553 


• 3021 


.2640 


.2397 


.2551 


• 2825 


.2598 


H 


32. R-232 63 Capital. 


.2728 


.2357 


.3094 


• 2458 


.2688 


.2500 


.2734 


• 2006 


• 1493 


• 2184 


.2494 


.2027 




33. R-233 63 Punct. 


• 4665 


• 4038 


• 5140 


• 5273 


• 4947 


• 4244 


• 4107 


• 3596 


.3424 


. 3349 


.3297 


• 2861 


2 


34. R-234 63 Eng. Usage 


• 4287 


• 3662 


• 4573 


. 3979 


• 3927 


.3864 


. 3646 


• 3466 


*2940 


• 3372 


.3389 


.2652 


1 


35. R-235 63 Eff. Exp. 


• 3961 


• 3318 


• 4123 


.3620 


• 3519 


.3378 


.3570 


.3059 


• 2771 


.2862 


.3014 


• 2317 


H 


36. R-240 63 Word.Funct 


• 4769 


•4399 


• 5023 


.55l> 


• 5065 


.4089 


• 3787 


• 3861 


• 3243 


.3090 


.3027 


.2936 




37. R-250 63 Rdg* Compr 


• 5629 


.4983 


.6103 


• 5138 


.5746 


.5154 


• 4869 


.4897 


.4196 


.4669 


• 4443 


.3631 




36. R-260 63 Creativity 


• 4622 


.4525 


.4527 


.4509 


.5073 


.4330 


.4233 


• 4634 


.4625 


.4882. 


.3759 


.3526 




39. R-270 63 Mech.Reaa 


• 3299 


• 3221 


.3694 


• 3839 


• 4764 


• 3931 


.3687 


.4411 


,455b 


• 4509 


.3590 


.3169 




40. R-281 63 Via. 2 Dim 


.2151 


• 2316 


.2288 


• 2884 


.2790 


• 1986 


• 2019 


.2467 


• 2676 


• 2524 


.1896 


• 1803 




41. R-282 63 Vis. 3 Dim 


.3077 


.2796 


.3248 


• 3653 


.3707 


• 3217 


• 2931 


• 3393 


.3346 


• )?25 


• 2080 


• 2189 




42. R-290 63 Abst«Roas 


• 3569 


• 3286 


• 4105 


.4315 


• 4236 


.3395 


• 3518 


.3575 


.3214 


.3201 


• 2713 


.2413 




R-311 63 Arith.Reas 


.4577 


.3905 


.5440 


.5402 


• 5113 


.4478 


• 4820 


• 3992 


.4339 


.4273 


• 4076 


.3428 




44. R-312 63 Int.HSMath 


.4844 


.4311 


.5987 


• 6506 


• 5631 


• 4586 


• 4372 


.4079 


• 4224 


.3499 


.3492 


.3148 


SS 


45. R-333 63 Adv.HSMath 


.4617 


• 3926 


• 5083 


.6206 


• 4987 


• 4244 


.3788 


.3986 


.3678 


.2866 


.2905 


.2661 




6^ F-4iO 63 Arith.Comp 


.1981 


• 1923 


.3043 


.2643 


.24M 


.2148 


.2191 


• 1608 


.1567 


• 2094 


• 2443 


.1536 




47. F-420 63 Table Read 


• 1398 


• 1199 


• 1168 


• 1334 


• 1436 


.0255 


.0734 


• 1002 


.0928 


• 0848 


.0557 


.0985 




4R. F-430 63 Cler* Check 


.2211 


.2215 


• 2312 


.1911 


.2463 


.1252 


• 1 354 


. 1498 


.1768 


.1517 


• 1134 


• 1249 




t. 9 . F-440 63 Obj.Inap. 


• 1258 


.1231 


(^1056 


• 1246 


• 1436 


• 1229 


• 0929 


.1323 


• 1119 


• 1303 


• 0571 


• 0916 




■ 5 ^ R-102 60 Vocab. I 


.6806 


• 6133 


.7222 


• 6450 


.6886 


• 6236 


• 54H2 


.6324 


.5949 


• 6102 


• 5228 


.4810 




51. R-103 60 literature 




.6296 


.6907 


.5882 


.5957 


.5608 


• 4513 


.5473 


• 4562 


• 4439 


.4193 


.4078 




52. R**104 60 Music 


.6296 




.6013 


.5639 


.5126 


.4674 


• 3954 


• 5066 


.4294 


• 4221 


• 3816 


• 3987 




53. 8-105 60 Soc. Stud. 


• 6907 


.6013 




.6338 


.6791 


. 5974 


• 5021 


• 5718 


.5086 


• 4983 


• 4H6L 


• 4374 




54. R-106 60 Math 


• 58B2 


.5639 


• 6338 




• 6181 


.5162 


.4500 


• 5247 


• 4911 


.4446 


.3857 


.4036 


• 


55. R-107 60 Phya. Sci. 


.5957 


.5126 


.6791 


.6181 




.6032 


.4564 


.5998 


.6350 


.5125 


.4723 


.4261 




56 . R-108 6d‘ Bio. Sci. 


.5608 


.46 74 


.5974 


.5162 


.6032 




• 4582 


.5319 


.4863 


.4876 


.4935 


• 3BBS 




57. R-109 60 Sclent. Att 


.4513 


.3954 


.5021 


.4500 


.4564 


.4582 




• 4189 


.3961 


.4264 


.3693 


.3165 




58. R-110 60 Aero-Space 


.5473 


.5066 


.5718 


.5247 


• 5998 


.5319 


.4189 




• 5612 


.5198 


• 4005 


.3725 




59. R-111 60 Electronic 


.4562 


.4294 


• 5086 


• 4911 


• 6350 


.4863 


.3961 


• 5612 




.5791 


.4108 


.3975 


u 


60 . R-112 60 Mechenica 


• 4439 


.4221 


.4983 


.4446 


• 5125 


.48/6 


.4264 


.5198 


• 5791 




• 5069 


.4383 




61. R-113 60 Farming 


.4193 


.3816 


• 4861 


.3857 


.4723 


.4935 


. 3693 


• 4005 


.4108 


.5069 




• 3913 


#4 


62. R-114 60 Home Ec. 


• 4078 


• 3987 


.4374 


.4036 


.4261 


.3888 


.3165 


.3725 


.3975 


• 4383 


.3913 




1 


63. R-115 60 Sports 


• 5062 


.4773 


.5784 


.4971 


.4410 


.4014 


.3974 


.4107 


. 3028 


.3604 


.3448 


.3331 




64. R-131 60 Ar*^ 


.6176 


• 5572 


.6009 


.5062 • 


.5300 


.4697 


.4270 


.5279 


.4417 


.4609 


.392/ 


• 3966 


1 


65. R-132 60 taw 


.5341 


.4520 


• 5618 


.4655 


.4651 


.4278 


.3952 


.4650 


.4025 


.4022 


.3397 


• 3335 


1 


66. R-133 60 Health 


• 5439 


• 4942 


.5882 


.4915 


.5274 


.4902 


.4220 


• 4533 


.4137 


.4623 


.4342 


.4007 


A 


t7. R-134 60 Engin* 


.3953 


• 3868 


.4474 


•4058 


.4506 


.4029 


.3520 


.4241 


.4441 


.4723 


.3537 


.3514 




689 R-135 60 Arch. 


.4239 


.387 3 


.4002 


• 36 34 


.3440 


.3095 


• 2366 


• 3364 


.2899 


.2864 


• 2485 


.2 762 




69. R-138 60 Military 


.4845 


• 4403 


.4993 


.4211 


.3992 


.3450 


• 30 30 


.4171 


.33 79 


.3218 


.2483 


.2550 




70. R-139 60 Acct^Busi. 


.4 739 


.4422 


.5347 


.4767 


.4658 


.4227 


.3777 


.4366 


.4001 


.4 333 


.3546 


• 3696 




71. R-140 60 Prac.Knovl 


.4406 


• 3940 


.4910 


• 4043 


.4193 


.3674 


• 36 73 


.3807 


.3389 


• 4132 


.3178 


.3365 




72. R-142 60 Bible 


.5353 


.4590 


.5362 


• 4403 


.4486 


.4329 


.3777 


.4022 


• 3248 


• 3200 


.3805 


• 2893 




73. R-145 60 Hunting 


.1017 


• 0682 


.1164 


.0645 


. 1540 


.2088 


.1359 


.1460 


.1506 


• 2633 


• 2912 


.1425 




74. R-146 60 Fishing 


.1970 


.1512 


.2082 


• 1789 


.2343 


.2979 


.2242 


.2313 


.1923 


.2883 


.2548 


• 1928 




75. R— 147 60 Outdoor 


.4862 


• 4296 


.5415 


.4758 


.4929 


.4617 


• 4268 


.4766 


.4349 


.4657 


• 3988 


.3855 




76. R-150 60 Theater 


.5635 


.5319 


.5317 


• 4755 


.4635 


.4080 


.3813 


.4794 


.3771 


.4164 


.3550 


.3660 




77. R-162 60 Vocab. II 


.6124 


.5635 


.6469 


.5701 


.569 7 


.5253 


.4616 


.5360 


.4853 


.5159 


• 4420 


.4191 




7T. R-212 60 Mem. Words 


.3857 


.3482 


.3811 


.3888 


• 3657 


.3236 


.2824 


.2736 


.26 78 


.2444 


.2643 


.2229 


*« 


79. R-220 60 Disg. Wds. 


.5092 


.4642 


.4707 


• 4790 


• 4345 


.3966 


.3802 


.3924 


• 3357 


B36 


.3458 


.3081 


■ 

a 


B5I R-231 60 Spelling 


.4354 


• 3829 


.4443 


.464,2 


.3996 


.3334 


.2987 


.3062 


.2584 


731 


.2967 


.2437 


H 


81. R-232 60 Capital. 


.3414 


.3100 


.4030 


. >426 


.3619 


.3003 


• 3069 


• 2653 


.2460 


.2974 


.2837 


.2451 


3 


82. R-233 60 Punct. 


. .4722 


• 4440 


.5372 


.5562 


.5066 


.4348 


• 4 188 


.4030 


• 3802 


• 3712 


• 3669 


• 3157 


r4 


83. R-234 60 Eng. Usage 


.4113 


.3582 


• 4559 


.4239 


.4077 


.3976 


.3724 


.3618 


.3201 


.3767 


• 3586 


.2908 


3 


84. R-235 60 Eff. Exp. 


• 3606 


.3112 


.3847 


• 3708 


.3455 


.3192 


.3687 


.3021 


• 2600 


• 3061 


.2787 


.2355 


m 


85. R-240 60 Word.Funct 


.4575 


.4264 


.4904 


.5645 


.4619 


.4028 


. 3490 


.3 758 


• 3450 


.2785 


.2935 


• 2627 




86. R-250 60 Rdg. Compr 


• 6653 


.5875 


.7043 


.6158 


• 6247 


.5861 


.5375 


.5651 


• 4931 


• 5009 


• 4827 


• 4205 




87. R-260 60 Creativity 


• 4856 


• 4497 


.4799 


.4975 


.4821 


.4395 


.4003 


• 4897 


• 4729 


.4797 


.3713 


. 3749 




88. R -270 60 Mech.Reas 


.3658 


.3639 


• 4182 


.4596 


.4901 


.4400 


.3737 


• 491 L 


• 5241 


• 5026 


• 3723 


• 3203 




89. R-281 60 Vis. 2 Dim 


.2208 


.2067 


.2247 


.2817 


.2598 


.2020 


.2231 


.2354 


.2613 


.2551 


• 2045 


• 1929 




90. R-282 60 Via. 3 Dim 


*2885 


• 2853 


.3175 


.3913 


• 3596 


. 2979 


.2717 


.34 36 


.3516 


.3176 


.2359 


.2 395 




91. R-290 60 Abst.Ress 


.3675 


.340 7 


.4225 


.4793 


.4215 


. 3479 


. 3751 


• 3616 


• 34<!2 


• 3160 


.2877 


• 2664 




R-311 60 Arith.Reas 


.4766 


.4330 


.5658 


.6068 


.5504 


.4652 


• 4667 


• 4434 


.4575 


• 4347 


.3059 


.3437 


^8 


93. R-312 60 Int.HSMath 


.5128 


.4784 


.5687 


.6807 


• 5323 


.4385 


.4129 


.4227 


• 3961 


.3726 


.3394 


• 3356 


3h 


9A. R-333 60 Adv.HSMath 


.1787 


• 1523 


. 1586 


• 2561 


.1711 


• 1248 


.1244 


• 1541 


.1473 


• 1295 


• 0896 


.1095 




95* F-410 60 Arith.Comp 


• 2343 


.2257 


.3135 


.2841 


.2527 


.1978 


.2295 


.1742 


• 1711 


• 1867 


.2224 


• 1848 




96. F-420 60 Table 


.1520 


. 1500 


.1797 


• 1492 


. 1634 


• 1423 


. 1536 


.1099» 


• 096C 


• 1166 


• 1398 


• 1225 




97. F-430 60 Cler. Check 


.2086 


.1861 


.2078 


.2261 


. 1851 


.1416 


.1723 


• 1372 


• 0926 


• 1082 


.1241 


• 1196 




98. F-440 60 Obj.Inap. 


.1232 


• 1191 


• 0973 


.1010 


• 0980 


.0969 


.1010 


.0956 


• 0640 


.1032 


.0617 


• 0808 




99. P*801 60 Socioecon. 


.3814 


.3841 


.3765 


• 3733 


.3202 


.2598 


.2883 


.3348 


• 2967 


.2838 


• 1740 


• 2200 



o 



6-9 



TABLE 6-l« (continued) 



i 



6a 


66 


65 


66 


67 


68 


69 


70 


71 


72 


73 


76 


75 


Varieblc 


«A87<i 


.5700 


.5103 


.S600 


.6687 


• 3511 


.4296 


• 6751 


.6919 


.6797 


.1635 


• 2653 


• 5526 


1. R-102 63 


.4 SAB 


.5865 


.5109 


• 5396 


• 3828 


• 3nro 


.45!>9 


• 6656 


•6531 


.5569 


• 0896 


• 1766 


.6926 


2. R-X03 63 




• 56 16 


.A7J9 


.90)9 


• 3723 


.3)60 


• 6611 


• 6602 


.6565 


.6839 


• 0362 


• 1873 


.6707 


3. R>104 63 




.5181 


.6915 


.9056 


.)96J 


• 1273 


.4136 


.6638 


.6522 


.6903 


• 1263 


• 1750 


.6672 


4. R»X05 63 


•9136 


.9869 


.6806 


.5275 


.)906 


.3101 


.4100 


•6699 


• 6365 


• 6596 


• 0663 


• 1815 


• 5035 


5. R-106 ^3 


.4)62 


.5115 


.6032 


• 5370 


.6276 


.31 n 


.}861 


• 6666 


• 6326 


«6563 


• 1605 


.2093 


• 5017 


6. R-107 63 


.320A 


.9303 


.6060 


.6908 


.)676 


.2766 


.2910 


• 3666 


.3675 


.6257 


.2662 


.2690 


.6X99 


7. R-108 63 




.9037 


.6056 


• 3976 


• 3216 


.2316 


• 3116 


.3558 


• 3566 


1)3666 


• UOl 


• 1526 


.6237 


8. R-109 63 


*3977 


.6808 


.6760 


• 6705 


.6237 


.3128 


• 3996 


.6063 


• 6058 


• 3980 


• 1562 


.2355 


• 6639 


9. R-UO 63 


.3005 


.6502 


• 6225 


• 6516 


• 6660 


.2967 


.))9) 


•6169 


.3863 


• 3556 


• 1769 


• 2135 


.6711 


10. R-Ul 63 


.2312 


• 3656 


.3267 


• 3660 


• 3853 


.2196 


• 2669 


.3255 


• 3255 


• 25/3 


.2913 


. .2619 


.3996 


11. R-112 63 


.2207 


.2552 


.2368 


• 2900 


• 2690 


.1767 


. 16^6 


• 2366 


• 2616 


.3’23 


.3127 


.2373 


.2959 


12. R-113 63 


! .2676 


.3672 


.3189 


• 3602 


.3055 


.2224 


.2157 


• 3167 


• 3150 


• 2666 


.1379 


• 18H6 


.33X0 


13. R-114 63 


.6992 


.3777 


• 3660 


. 3801 


.2966 


.2370 


.3310 


• 3600 


.3519 


.3373 


.0720 


• 1689 


• 3963 


14. R-llS 63 


.6306 


.6356 


.6752 


• 5026 


.)9)1 


.32 76 


.415 7 


• 6668 


.6559 


• 66 76 


.0986 


• 1676 


• 6660 


15. R-131 63 


1 .6106 


• 6660 


.5257 


.6 760 


.3666 


• 2312 


.3721 


• 66 30 


• 3806 


•6107 


• 1169 


• 1588 


• 6299 


16. R-132 63 


.a990 


.9961 


.398) 


• 5133 


• 3768 


.24S9 


.3169 


• 379E 


• 6088 


• 3338 


• 1615 


• 1960 


• 6198 


17. R-133 63 


.30ia 


.3797 


• 3697 


• 3672 


.6079 


.210) 


.2608 


• 3371 


• 3663 


• 2963 


.1968 


.190/ 


.3857 


18. R-134 63 


.3366 


.9998 


• 3686 


• 3666 


.29)6 


.3792 


• 3668 


.3570 


• 2925 


• 3661 


• 0770 


• 1203 


• 3532 


19. R-135 63 


.9109 


• 6282 


.6166 


.6060 


• 2782 


.2139 


• 6769 


• 3366 


• 3192 


• 3667 


• 1030 


• 1351 


• 3666 


20. R-138 63 


.3503 


• 6220 


• 3976 


.6?21 


.))81 


.2590 


• 3600 


• 6667 


• 36X0 


• 3632 


• 1215 


.1510 


• 6152 


21. R-139 63 


.3902 


• 3809 


.3)91 


• 3 702 


.3011 


• 1681 


• 2906 


• 3612 


.6786 


• 2966 


• 1360 


• 1390 


• 3909 


22. R-140 63 


.3672 


.6535 


• 6610 


• 6375 


• 3063 


.2 702 


.39)2 


• 3855 


.3653 


• 7313 


• 0900 


• 1616 


.3660 


23. R-142 63 


•0206 


.0717 


.0978 


.089) 


• 1316 


.02!,0 


• 0668 


• 0991 


• 0339 


• 0885 


.5199 


.2937 


• 166? 


24. R-145 63 


.2296 


• 2270 


.20)7 


.2626 


• 237r 


.1325 


.1600 


• 2159 


• 2C63 


• 1966 


• 3606 


• 5316 


• 2632 


25. R-146 63 


• i960 


.3981 


.)757 


• 6198 


• 3688 


• 2359 


• 3 3.32 


• 3525 


• 3681 


• 3683 


• 2291 


• 2208 


• 5335 


26. R-147 63 


.9503 


• 5636 


• 6633 


• 6961 


.3602 


• 2791 


• 6173 


.6093 


• 6181 


• 6127 


• 1036 


• 1669 


• 6636 


27. R-150 63 


.9359 


.5237 


•6512 


• 5169 


• 6192 


.2579 


• 3797 


• 6559 


.6796 


.6103 


• 1662 


• 1861 


.676 7 


28. R-162 63 


• 30SI 


.3130 


• 2639 


.2999 


• 2231 


• 1966 


• 1976 


• 2586 


• 2528 


• 3169 


• 0667 


• 1075 


• 2706 


29. R-212 63 


• 3625 


.9959 


• 3282 


• 6060 


• 3168 


• 26 32 


.2912 


• 3150 


• 3657 


.2867 


• 0628 


• 1062 


.3518 


30. R-220 63 


• 3502 


.3730 


.2991 


• 3922 


.2696 


• 2209 


.2547 


• 3036 


• 3215 


• 3215 


• 0659 


• 1099 


• 3152 


31. R-231 63 


• 2633 


• 2718 


.2190 


• 2770 


• 2068 


.1500 


• 1762 


• 2185 


.2716 


• 2663 


• 0559 


• 0892 


• 2586 


32. R-232 63 


It 


.9339 


• 3782 


• 6000 


.)201 


• 2620 


• 3188 


• 3732 


• 6093 


• 6202 


• 0829 


• 1308 


• 3869 


35. R-233 63 


• 3361 


• 3930 


• 3509 


• 3016 


• 2776 


• 2602 


• 2715 


• 3296 


• 3510 


• 3613 


• 0862 


• 1386 


• 3339 


34. K-234 63 


• 3216 


.3869 


• 3112 


• 3326 


.2553 


.2266 


• 2566 


• 3021 


• 3093 


• 3253 


• 0981 


• 1256 


• 3266 


35. R-235 63 


• 6056 


• 6183 


.3860 


.6299 


.3178 


.2803 


. 3294 


.3775 


• 3635 


•6267 


• 0396 


• 1281 


• 3667 


36. U-240 63 


•6713 


• 5162 


• 6533 


• 6900 


• 6026 


• 3155 


• 3663 


• 6210 


• 6606 


•6766 


• 1225 


• 1986 


• 6790 


37. R-250 63 


.3258 


• 6672 


•3016 


.6207 


• 3968 


.2809 


• 3366 


• 3763 


• 3666 


.3755 


• 1679 


• 1969 


• 3938 


38. R-260 63 


• 2360 


.3921 


• 2966 


• 3121 


• 3659 


• 2167 


.2416 


• 2951 


.2961 


•2907 


• 16^6 


.1589 


• 3732 


39. n-270 63 


.1723 


• 2393 


.1666 


• 1523 


• 1950 


• 1630 


• 1197 


• 1863 


• 1886 


• 1558 


• 0310 


• 0866 


• 211V 


40. R-281 63 


• laso 


.2998 


• 2536 


• 2350 


• 2632 


• 2X37 


• 1965 


• 2528 


• 2579 


• ?508 


• 0926 


• 1113 


• 2696 


41. R-282 63 


.321? 


• 3617 


• 2960 


• 3256 


.2909 


• 2220 


.2316 


• 3005 


• 3207 


• 3069 


• 0713 


• 1121 


• 3337 


42. R-290 63 


• 6602 


• 6307 


• 6016 


• 6176 


• 3855 


• 2790 


• 3363 


.6553 


• 6192 


.396 3 


• 1330 


• 1720 


.6263 


43. R-311 63 


• 5060 


• 6365 


• 6263 


• 6337 


• 3517 


• 2808 


• 3606 


•6238 


• 6027 


• 3760 


• 0556 


• 1565 


• 6693 


44. R-312 63 


1 ^6526 


• 3567 


• 3395 


• 3650 


• 2932 


• 2623 


• 2977 


• 3526 


.3277 


.3253 


• 0667 


• 1376 


• 3622 


45. R-333 63 


1 ^3037 


• 2389 


• 2180 


• 2670 


• 2323 


• 1506 


• 1622 


• 2288 


• 2652 


• 2067 


• 0930 


• 1006 


• 2572 


46. F-410 63 


1 •1631 


• 1177 


• 0737 


• 1232 


• 0606 


.0916 


• 0693 


• 1098 


• 1612 


• 0875 


• 0022 


-•0260 


• 0909 


47. F-420 63 


• 2130 


• 2101 


• 1529 


• 2023 


• 1262 


• 1118 


• 1655 


• 1706 


• 1910 


.1335 


• 0257 


•0699 


• 1526 


48. F-430 63 


• 1361 


• 1360 


•0602 


• 1032 


• 1167 


• 0681 


• 0656 


• 0965 


• 1803 


•0535 


• 0569 


• 0663 


• 1701 


49. F-440 63 


• 5610 


• 6256 


• 5558 


• 5900 


• 5029 


.3956 


• 6579 


• 5505 


• 5127 


• 5065 


• 1526 


• 2712 


• 5726 


SO. R-102 60 


• 5062 


• 6176 


• 5361 


• 5639 


• 3953 


.6239 


• 6865 


.6739 


• 6606 


• 5353 


• 1017 


• 1970 


• 6862 


51. R«'103 60 


• 6773 


• 5572 


• 6520 


• 6962 


• 3066 


• 3873 


• 6603 


• 6622 


• 3960 


• 6590 


• 0682 


• 1512 


• 6296 


52. R-104 60 


j •5786 


• 6009 


•5618 


• 5002 


.6676 


• 6002 


• 6993 


• 5367 


• 6910 


.5362 


• 1166 


• 2082 


• 5615 


53. R-105 60 


•6971 


• 5062 


• 6655 


• 6915 


• 6058 


.3636 


• 6211 


• 6767 


• 6063 


• 6603 


• 0665 


.1789 


• 6758 


54. R-106 60 


•6610 


• 5300 


• 6651 


• 5276 


• 6506 


• 3660 


• 3992 


.6658 


• 6193 


• 6666 


• 1560 


• 2363 


• 6929 


55. R-107 60 


• 6016 


• 6697 


• 6278 


• 6902 


• 6029 


• 3095 


• 3650 


•6227 


• 3676 


• 6329 


• 2088 


• 2979 


• 6617 


56 . R-108 60 


• 3976 


• 6270 


.3952 


• 6220 


.3520 


• 2366 


• 3030 


.37/7 


.3673 


.3777 


• 1359 


• 2262 


• 6268 


. 57. R-109 60 


• 6107 


• 5279 


• 6650 


• 6533 


• 6261 


• 3386 


• 6171 


• 6366 


• 3807 


• 6022 


• 1660 


• 2313 


• 6766 


58. R-110 60 


• 3028 


• 6617 


• 6025 


.6137 


• 6661 


• 2699 


• 3379 


• 6001 


• 3389 


• 326 6 


• 1506 


• 1923 


• 6369 


59. R-111 60 


• 3606 


• 6609 


• 6022 


• 6623 


.6723 


• 2866 


• 3218 


• 6333 


• 6132 


.3200 


• 2633 


• 2883 


.6657 ' 


60. R-112 60 


• 3668 


• 3927 


• 3397 


• 6362 


• 3537 


• 2685 


• 2683 


• 3566 


• 3178 


• 3605 


• 2912 


• 2568 


• 3988 


61. R-113 60 


• 3331 


.3966 


• 3335 


• 6007 


• 3516 


• 2762 


• 2550 


• 3696 


• 3365 


• 2693 


• 1625 


• 1928 


.3055 


62. R-114 60 




• 6295 


• 6266 


• 6665 


• 3156 


• 2661 


• 6012 


•6069 


• 6066 


• 3586 


• 0922 


• 1973 


• 6370 


'63. R-115 60 


• 6295 




• 5106 


• 5722 


• 6513 


• 3957 


• 6389 


• 5001 


• 5039 


• 6650 


• 1163 


.2190 


• 5016 


64. R-131 60 


• 6266 


• 5i06 




• 6753 


.3663 


• 3026 


• 6233 


• 6869 


.6311 


• 6657 


• 1602 


• 1860 


.6677 


65. R-132 60 


• 6665 


• 5722 


• 6753 




• 6631 


• 3253 


• 3703 


•6979 


.5029 


• 6667 


• 1622 


• 2282 


• 5099 


66. R-133 60 


• 3156 


• 6513 


• 3663 


• 6631 




• 2890 


• 2866 


• .3800 


• 6360 


• 3296 


• 1611 


• 2050 


• 6670 


67. R-134 60 


• 2061 


• 3957 


• 3026 


• 3253 


• 2690 




• 3099 


• 3088 


.2737 


• 3292 


• 0606 


• 1668 


• 3105 


68. R-135 60 


• 6012 


• 6309 


• 6233 


• 3 703 


• 2866 


• 3099 




• 396/ 


• 3256 


• 3605 


• 0519 


• 1502 


• 3599 


69. R-138 60 


• 6069 


• 5001 


• 6069 


•J^979 


• 3800 


• 3088 


• 396 7 




• 6366 


• 6162 


• 1291 


• 1960 


• 6627 


70. R-139 60 


• 6066 


• 5039 


.6311 


• 5029 


• 6360 


• 2737 


• 3256 


• 6366 




• 3963 


• 1176 


• 2082 


• 5030 


71. R-140 60 


• 3586 


• 6050 


•6657 


• 6667 


• 3296 


• 3292 


• 3805 


•6182 


• 3963 




• 1378 


• 2082 


• 6067 


72. R-142 60 


• 0922 


• 1163 


• 1602 


• 1622 


. 1611 


• 0606 


.0519 


.1^91 


.11/6 


• 1376 




• 3162 


• 2060 


73. R-145 60 


• 1973 


• 2190 


• 1060 


• 2202 


• 2058 


• 1668 


• 1502 


• 1960 


• 2082 


.2082 


• 3162 




• 2715 


74. R-146 60 


• 6370 


• 5016 


.6677 


• 5099 


• 6678 


• 3185 


• 3599 


.6627 


• 5038 


• 6f <»7 


• 2068 


• 2715 






• 6605 


.5590 


• 6026 


• 6963 


• 3826 


• 3672 


• 6175 


• 6858 


• 6625 


• 6k09 


• 0658 


• 1568 


• 6556 


• 5016 


• 6533 


• 5852 


• 6303 


• 6008 


• 3602 


• 6600 


• 6390 


.5306 


• 6981 


• 1601 


• 2661 


• 5900 


77. R-162 60 


• 3055 


• 3259 


• 2001 


• 3230 


• 2519 


• 2281 


• 2365 


• 2615 


• 2550 


• 3017 


• 0593 


• 1376 


• 2667 


78. R-212 60 


• 6230 


• 6669 


• 3757 


• 6561 


• 3220 


• 3059 


• 3369 


• 3591 


.3821 


• 3791 


• 1019 


• 1971 


• 6052 


79. R-220 60 


1 ^3770 


• 3667 


• 3366 


• 6126 


• 2559 


• 2661 


• 2902 


• 3093 


• 2881 


.3261 


• 0563 


• 1612 


• 3133 


80. R-231 60 


! •3598 


• 3566 


• 2878 


• 3553 


• 2909 


• 1988 


• 2601 


• 2869 


• 3357 


.2966 


• 0667 


• 1623 


• 3335 


61. R-232 60 


1 •6131 


• 6307 


.3935 


• 6506 


• 3561 


• 2697 


.3292 


• 6061 


• 3932 


• 6100 


• 0696 


• 1586 


• 6159 


82. R-233 60 


! ^3662 


• 3056 


• 356 7 


• 6066 


• 2900 


• 2395 


• 2951 


• 1665 


• 3366 


• 3565 


• 1267 


• 1596 


• 3610 


83. R-234 60 


! •3366 


• 3576 


• 32 78 


• 3505 


• 2^69 


• 1887 


• 2613 


• 3116 


• 2980 


• 2983 


• 1056 


• 1186 


• 3356 


84. R-235 60 


; •3705 


• 3992 


• 3662 


• 6021 


• 3155 


• 2712 


• 3201 


• 3576 


.3069 


• 6136 


• 0658 


• 1161 


• 3669 


85. R-240 60 


j •5196 


• 6185 


• 5658 


• 5925 


• 6792 


.3762 


.6669 


• 5286 


• 5075 


.5567 


• 1579 


• 2663 


• 5697 


86. R-250 60 


[ .3626 


• 6925 


• 6136 


• 6357 


• 3<?26 


• 3215 


• 3596 


• 6226 


• 3839 


• 3807 


• 1526 


.2095 


• 6530 


87. R-260 60 


^ .2925 


• 3060 


• 3328 


• 3629 


• 3656 


• 2577 


.2552 


• 3377 


• 3286 


.2966 


• 1968 


• 2197 


• 6186 


88. R-270 60 


• 2001 


• 2691 


• 2061 


• 2061 


• 1998 


• 1755 


• 1562 


• 2050 


• 2136 


• 1736 


• 1033 


• 0969 


• 2650 


89. R-281 60 


j .1902 


• 3076 


• 2663 


• 2317 


• 2566 


• 1985 


• 2012 


• 2691 


• 2170 


• 2235 


• 0791 


• 1050 


• 20X0 


90. R-2E7 60 


1 ^3377 


• 3387 


• 2926 


• 3025 


• 2976 


.2285 


• 2676 


• 2975 


• 3066 


• 2696 


• 0658 


• 1115 


• 3673 


91. R-290 60 


1 .6370 


• 6696 


• 6298 


• 6636 


• 3797 


• 3065 


• 3667 


• 6611 


• 3836 


• 6051 


• 0978 


• 1796 


• 6335 


92. R-311 60 


^ •6633 


• 6699 


•6162 


• 6565 


• 3572 


• 2968 


• 3682 


•6225 


• 3698 


• 6066 


• 0629 


• 1329 


• 6306 


93. R-312 60 


• 1652 


• 1638 


• 1315 


• 1176 


.1067 


• 1338 


• 1188 


• 1350 


• 1117 


• 1512 


.0313 


• 0717 


• 1390 


94. R-333 60 


• 2917 


• 2369 


• 2363 


• 266 3 


• 2226 


• 1669 


• 1625 


• 2319 


• 2880 


• 2153 


• 0392 


• 0956 


.2556 


95. F-410 60 


• 1765 


• 1567 


• 1506 


• 1002 


• 1339 


• 0622 


• 1067 


• 1829 


• 2085 


• 1262 


• 0652 


• 0563 


• 1716 


96. F-420 60 


e>2182 


• 2015 


• 1765 


• 2091 


• 1336 


• 1353 


• 1607 


.1575 


• 1925 


.1556 


.0157 


• 0868 


• 1633 


97. F-430 60 


• 1003 


• 1660 


• 0953 


• 1090 


.0981 


• 0622 


• 0652 


• 0926 


• 1519 


• 0531 


• 0528 


• 0926 


• 1336 


98. F-440 60 




• 3366 


• 2009 


• 3312 


.2671 


• 2169 


.2590 


• 2963 


• 2705 


• 2169 


-•0065 


•0621 


• 3682 


99. P*801 60 


o 

ERLC 
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TABIE 6-ia (continued ) 





WfiMblo 


T6 


77 


78 


79 


80 


ai 


82 


63 


86 


85 


86 


a? 




17 u-ioa u3 Vvcab. I 




.6692 


.3771 


.5226 


.6098 


.3159 


.5305 


,6685 


• 6101 


.6668 


• 6888 


.5235 




2. i\"l03 o3 Literature 


• 539^ 


.5989 


• iB20 


.5230 


.6239 


.2961 


,6968 


• 6225 


.3 796 


.6 726 


• 6665 


,6638 




3. ;s-lOA 63 Muiiic 


• 530^ 


.5839 


.nil 


.6977 


.3998 


.2936 


.6671 


• 6121 


,1615 


.6326 


• 6060 


• 6667 




i. S«103 63 ;^ec. Stud. 


.^$13 


.5523 


• i 7 6 


,6669 


.3902 


.3262 


.^t96 8 


.6209 


• 3666 


.6306 


,6662 


.6 3 70 




j. L-luo u3 .'lath 


• ^690 


.5891 


.6 106 


.5126 


.6567 


.3106 


.5911 


• 6662 


,3916 


.5790 


• 6618 


.6856 




ti. R-X07 63 Phys. Sei. 


• ^621 


.5820 


. 3 765 


.6613 


.3925 


.2913 


.5 32 3 


,6292 


.3666 


.6 798 


• 6198 


• 6867 




S-iOo 63 Bio. Sci. 


• 36^3 


.6570 


.2787 


.3707 


.2560 


.2191 


. 3896 


,3651 


.2956 


.3669 


.5316 


.6102 




a, H-10'3 63 Sclent. Att 


• 366^ 


• 6610 


.2610 


. 3795 


. 2765 


.2209 


.6213 


.3583 


.3560 


.36 35 


.5292 


• 3882 




9. R-llO 63 Aero-Space 


.^730 


.5360 


.2666 


.3886 


.2 796 


.2361 


.3903 


.3757 


.2985 


.3658 


.5789 


• 6866 




10. U-lll 63 Electronic 


• 3688 


.5177 


.2675 


. 3728 


.2561 


.2360 


.6269 


.3699 


.3066 


.37*35 


.5169 


,6033 


u 


11. R-113 63 Mechanics 


• 2921 


.6115 


.1632 


.2755 


. 1509 


.1959 


• 2681 


.2983 


.253 1 


.2256 


.1922 


.3907 




12. R-113 63 Fanning 


.2307 


.3070 


. 1908 


.2576 


.2231 


.1900 


.2816 


.2866 


.2356 


.2272 


• 3616 


.2768 


ri 


13. R-114 63 Home Ec. 


• 3^^5 


.3750 


. 1675 


.2608 


.2056 


• 1953 


.2698 


.272 1 


.2287 


• 2631 


.3837 


. 366 7 




14. R-115 63 Sports 


• 36^0 


.6276 


.2913 


.3896 


.366 7 


.2887 


. 3 727 


.3091 


.3181 


.3656 


.6693 


• 3068 


44 


15. R-131 63 Arc 


• 52i^ 


.5796 


.2893 


.6689 


. 3656 


.3692 


.6105 


. 3937 


.3632 


. 1575 


• 5825 


• 6676 


i 


l6. R-132 63 Law 


.^281 


.5366 


.2758 


.3612 


.3296 


.3258 


.3793 


.3770 


.3158 


.3130 


.5232 


• 3620 


»s 


17. R-133 63 Health 


.^0^7 


• 6966 


.2655 


.6215 


.3286 


.3716 


.6199 


.3585 


. U25 


. 3366 


.5086 


.3762 




18. R-134 63 Engin. 


.336^ 


• 6103 


. 1665 


.2828 


.2052 


.3052 


.3178 


.3089 


.2626 


.2369 


.6071 


• 3621 




19. R-13S 63 Arch. 


.35^8 


.6216 


.2236 


.3216 


.2566 


.2729 


.3260 


.3115 


.2570 


.3020 


,6719 


.366 7 




20. R-133 63 Military 


• ^06S 


.6670 


.2133 


. 3506 


. 3275 


.3059 


.3516 


. 3307 


,2605 


.2936 


.6802 


.3586 




21. R-139 63 Acct.Busi. 


.3963 


• 5266 


.2310 


.3603 


• 2792 


.3151 


. 3 706 


.3606 


.2999 


.2986 


.6729 


• 6016 




22. R-140 63 Prac.Knowl 


• 3608 


.6320 


. 1577 


.3767 


.2827 


.3165 


.3307 


.2981 


.2506 


.2050 


,3967 


• 3316 




23. R-142 63 Bible 


.3693 


• 6868 


.3017 


.6069 


.3601 


.3317 


.6215 


.3858 


.3277 


• 3957 


.5596 


.3683 




24. R-145 63 Hunting 


.056^ 


• 0956 


.0200 


.0817 


.0625 


-.0037 


.0161 


.1362 


.0666 


-.0035 


• 132 7 


• 1300 




25. R-146 63 Fishing 


.17^2 


.2820 


. 1661 


• 2181 


• 1630 


.1716 


• IBld 


.2203 


.1635 


.1500 


.3012 


.2375 




26. R-147 63 Outdoor 


• 3620 


.6686 


.2329 


• 3766 


.3195 


• 3638 


.3701 


.3933 


. 3063 


.2681 


.6893 


.3977 




27. R-150 63 Theater 


• 5610 


• 5727 


.2733 


.6702 


.3857 


.3263 


.6186 


.3966 


• 3661 


.3630 


.5607 


• 6666 




28. R-162 63 Vocab. 11 


• ^601 


.6610 


.3193 


.6592 


.3620 


.3830 


.6505 


.65 76 


. 3 750 


.3666 


• ^833 


.6503 




29. R-212 63 Mem. Words 


.277^ 


• 3626 


.5126 


.3396 


• 3083 


• 3316 


. 3 766 


.2956 


.2567 


• 36 76 


.6<»60 


• 3116 


U 


30. R-220 63 Disg. Wds. 


«^U6 


.6760 


.3270 


.5852 


• 6 3 8 d 


.2561 


.6605 


.6028 


.3127 


.6111 


.5112 


. 3779 


M 

Q4 


TIT R-231 63 Spelling 


• 356^ 


.6287 


• 32 32 


• 6666 


• 6381 


.3998 


.6938 


.6002 


.3160 


.6365 


.6762 


• 3160 


H 


32. R-232 63 Capital. 


.2529 


.2996 


v2l66 


.2809 


.2919 


.3805 


. 3575 


.2962 


.2551 


.2557 


.3519 


.2675 


*0 


33. R-233 63 Punct. 


.3999 


.6893 


. 3568 


• 6536 


.66 79 


.6695 


.65/2 


,6775 


.3991 


.5329 


,5586 


• 6067 




34. R-234 63 Eng. Usage 


• 3662 


.6266 . 


.2937 


.6363 


.601 7 


.3091 


.6691 


.5225 


.3606 


.6353 


• 6861 


• 3869 


9 


35. R-235 63 Eff. Exp. 


.3317 


.3967 


.2?r5 • 


.3623 


. 3371 


.6083 


.6 309 


• 6 366 


,6538 


.3 706 


.6721 


.3526 


(3 


36. R-2A0 63 Word.Funct 


• 3623 


.6822" 


. 3 760 


.6362 


.6336 


.31/5 


.5696 


.6108 


.3611 


.6115 


.5597 


• 6053 




27. R-250 63 Rdg. Compr 


• ^631 


.5619 


.3509 


.65 79 


.6086 


.3613 


.5191 


.6667 


.6292 


.6766 


.6995 


.6975 




38. R-260 63 Creativity 


.^160 


.6705 


.3071 


.6003 


.3025 


.2728 


.63H7 


.3663 


.3605 


.3897 


.5522 


.5608 




39. R-270 63 Mech.Reas 


• 2667 


.3776 


.2537 


.3687 


. 1810 


.2263 


.3662 


.3376 


.2712 


.3196 ^ 


• 6356 


• 6222 




40. R-281 63 Via. 2 Dim 


.1935 


.2266 


.1669 


.2238 


. 1261 


.1372 


.2503 


.1782 


.1896 


.2330 


.2699 


• 2817 




41. R-202 63 Vis. 9 Dim 


.2196 


.3206 


.2166 


.2610 


. 1806 


.1815 


.3155 


.2637 


.2661 


.2965 


• 3636 


• 3819 




42. R-290 63 Abst.Reas 


.29^9 


. 3636 


.2903 


.3626 


.2616 


.2669 


.6368 


.3638 


.3311 


.3613 


.6599 


.6097 


44 


TJ". R-311 63 Arith.Reas 


• 3606 


.5156 


.3256 


.6153 


.3566 


.6665 


.5690 


.6530 


.3923 


.6666 


.5655 


.6798 


U (• 
(« 41) 


44. R-312 63 Int.HSMath 


.3922 


.5096 


.3792 


.6672 


.6586 


.6707 


.6073 


.6666 


.3667 


.5660 


.5919 


• 6696 


« H 


45. R-333 63 Adv.HS.Math 


..3386 


.6270 


.3306 


.6016 


.6001 


• 3608 


.5161 


.3921 


. 3223 


.5598 


.5163 


.3782 




4b. F-410 63 Arlth.Comp 


.2121 


• 2667 


.1797 


.2923 


.2685 


.3163 


.3693 


.2716 


.2296 


.2713 


.3066 


• 2066 




47. F-420 63 Table Read 


.1169 


.1067 


.0960 


.1628 


. 1652 


.1325 


.1279 


.1223 


.0917 


• 1360 


. 1395 


• 1069 




48. F-430 63 Cler. Check 


.1603 


.2236 


.2007 


.2656 
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.2138 


• 2136 


.0876 


.2643 


.2339 


• 2571 


.1043 


.2218 


.1/21 


• 2014 


.0823 


• 2463 


.2184 


.2216 


.0697 


.2999 


• 2039 


• 2481 


.1560 


.3130 


.1983 


.2186 


• 1320 


• 2636 


.1665 


• 1561 


.1529 


.1957 


• 1610 


• 1209 


• 1516 


.1691 


• 1458 


.1154 


.1828 


.2110 


. 1 766 


• 1564 


.2022 


.2689 


• 1966 


• 1948 


.1767 



• 3500 
.3424 

• 2496 
.4782 

• 1176 

• 1704 

• i436 

• 2949 

• 2343 

• 2257 
.3135 

• 2841 
.2527 
.1978 
.2295 

• 1 742 
.1 71 1 

• 1867 
.2224 
.1848 
.291 7 

• 2349 

• 2363 

• 2643 
.2226 

• 1469 
. 1625 
.2319 

• 2880 
.2153 

• 0392 
.0954 

• 2554 
.24/0 

• 2807 
. 1981 
.2337 
. 3059 

• 2933 

• 3368 
.2850 
.2866 
.2/62 
. 3546 
.2244 
.2027 
. 1922 
. 1704 
.2992 

• 3421 
.3500 
.0472 

. 3042 
.2953 

• 1 354 

• 1282 



• 2362 
.2400 
.1749 

• 2603 
.1514 
.1562 

• 1404 

• 1656 
.1520 

• 1500 
.1797 

• 1492 

• 1634 

• 1423 

• 1536 
.1099 
.0960 

• 1166 

• 1398 
. 1225 

• 1745 
.1567 

• 1506 
.1602 

• 1339 

• 0622 

• 1067 

• 1829 

• 2085 
.1262 

• 0452 
.0563 
.1714 
. 1603 

• 2002 
.0923 

• 2029 
.1824 

• 1998 

• 2300 
.1900 

• 1903 
.1789 
.2385 

• 1852 

• 1667 

• 2196 
.1487 

• 2190 

• 1853 

• 1835 
-.0044 

• 3042 

• 3586 
. 3479 

• I 150 



.2097 
.2722 
• 2228 

• 2879 
. 1764 

• 2657 
.1731 
.2090 



.0973 

• 1408 

• 0962 

• 13/2 

• 1396 

• 1601 
.2754 
• 1235 



99 

.3725 

• 3646 
.3925 

• 2831 

• 4053 

• 3480 

• 2241 
-2663 
.3177 

• 2989 

• 2162 
.0698 
.2122 

• 2803 
.3335 

• 2649 
.2743 

• 2012 

• 2713 
.2634 
.2884 
.2233 

• 2005 
-.0563 

.0634 

.3230 

• 3219 

• 3540 
. 1372 

• 3128 

• 1 738 

• 1426 

• 2714 
.2357 

• 2306 

• 3204 
.3169 
.2793 

• 2504 

• 1827 
.2174 
.2830 

• 3226 

• 3305 

• 3187 

• 1303 

• 1441 

• 1766 

• 1266 
.4127 



R*«103 63 
63 

H-103 63 
R-136 63 
R-IG? 63 
H-108 63 
R-109 63 
9, R-UO 63 

10. R-ill 63 

11. R-112 63 
12 ♦ R<13 63 
13, R-UA 63 

R-115 63 
R-131 63 
R-132 63 
R-133 63 
R-.13A 63 
R-135 63 
R-X38 63 
R-X39 63 
R-IAO 63 
R-1A2 63 
R-IA5 63 
R-1A6 63 

26. R-1A7 63 

27. R-150 63 
R-X62 63 
R-212 63 
R-220 63 
R-231 63 
R-232 63 
R-233 63 
R-234 63 
R-235 63 
R-2A0 63 
R-250 63 
R-260 63 
R-270 63 
R-281 63 
R-282 63 
R-290 63 
R-311 63 
R-312 63 

A5. R-333 63 
A6. F-AIO 63 
F-A20 63 
F-A30 63 

49. F-440 63 

50. R-102 60 



2 . 

3. 

A. 

5. 

6 . 

7, 

8 . 



14. 

15. 

16. 

17. 

18. 

19. 

20 . 
21 . 
22 . 
23. 
2A. 
25. 



28. 

29. 

30. 

31. 

32. 

33. 
3A. 

35. 

36. 

37. 

38. 

39. 
AO. 
Al. 
A2. 
A3. 
AA. 



A7. 

A8. 



• 2086 


a232 


.3814 


51. R-103 60 


. 1861 


.1191 


.3841 


52. R-104 60 


• 2078 


.0973 


• 3765 


53. R-105 60 


• 2261 


• 1010 


• 3733 


SA. R-106 60 


• 1851 


• 0980 


• 3202 


55. R-107 60 


. 1416 


.0969 


• 2598 


56 . R_i08 60 


• 1723 


.1010 


• 2883 


57. R-109 60 


• 1372 


• 0956 


• 3348 


58. R-llO 60 


• 0926 


• 0640 


• 2967 


59. R-111 60 


. 1082 


• 1032 


• 2838 


60. R-112 60 


• 1241 


• 061/ 


.1740 


61. R-113 60 


.1196 


.0808 


• 2200 


62. R-llA 60 


.2182 


• 1003 


• 3236 


63. R-115 60 


.2015 


.1460 


• 3344 


6A. R-131 60 


• 1745 


• 0953 


• 2809 


65. R-132 60 


.2091 


* 1098 


.3312 


66. R-133 60 


• 1336 


• 0981 


• 2471 


67. R-13A 60 


.1353 


.0622 


• 2169 


68. R-135 60 


. 1407 


• 0452 


• 2590 


69. R-138 60 


.1575 


• 0928 


.2983 


70. R-139 60 


• 1925 


.1519 


.2705 


71. R-IAO 60 


• 1554 


• 0531 


• 2169 


72. R-1A2 60 


.0157 


• 0528 


-•0045 


73. R-1A5 60 


.0868 


.0924 


• 0621 


74. R-146 60 


• 1633 


. 1336 


• 3482 


75. R-147 60 


. 1883 


• 0936 


• 3371 


76. R-150 60 


.2180 


.1291 


• 3742 


77. R-162 60 


.1614 


.0953 


• 1031 


78. R-212 60 


• 3351 


.2033 


• 2729 


79. R-220 60 


• 2967 


• 0838 


• 2021 


80. R-231 60 


. 1884 


.0980 


• 1991 


81. R-232 60 


.2703 


.1343 


.2715 


82. R-233 60 


• 1931 


• 0936 


• 2571 


83. R-234 60 


• 1077 


• 1176 


• 2175 


84. R-235 60 


• 2467 


• 1274 


• 2920 


85. R-240 60 


• 2788 


• 1555 


• 3563 


06. R-250 60 


• 1965 


• 1808 


• 3065 


87. R-260 60 


. 1389 


• 2033 


• 2666 


88. R-270 60 


• 1939 


.2917 


• 1671 


89. R-281 60 


. 1330 


.2143 


• 2i60 


90. R-262 60 


.2147 


• 1 97 


• 2851 


91. R-290 60 


• 1846 


• 1094 


.3313 


92. R-311 60 


• 2223 


.1124 


• 3292 


93. R-312 60 


• 0267 


-.0067 


• 0823 


94. R-333 60 


.2953 


.1354 


• 1202 


95. F-410 60 


• 3586 


. 34 79 


• 1150 


96. F-420 60 




• 3252 


• 1 105 


97. F-430 60 


. 3252 




• 1115 


98. F-44*3 60 


• 1105 


.1115 




99. P*801 60 



by the special procedure described in Chapter 3 for estimating correlations when data 
arc missing, and for insuring that the matrix will be consistent. Retest weight Z was used. 

’ !he unweighted numbers of cases on which each correl.ation coefficient is based may be determined from Tabi. 2-5 
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I TABtK 6-lb» Gonal^ccint^ matrix of correlation among 99 variables (aptitude 

I information, achievement, socioeconomic index) 

Matrix IB« Baaed on females (matched cases only)^ 





Variable 


1 


2 


1 


4 


5 


6 


7 


0 


9 


10 


U 


12 




T7 R-102 63 Vncab. I 




. f329 


.6710 


.7220 


.6592 


.7151 


.6009 


.5650 


.49V0 


• 4060 


.5093 


.i7H< 




2. K-103 63 i.Ueratura 






• 652 7 


.72‘Wi 


.6555 


.6627 


.5910 


.4893 


.4467 


.4176 


• 3979 


.504 7 




3. l(-i04 u3 Mualc 


«^710 


• 652f 




.6317 


.5541 


.595 7 


.5151 


.4544 


.4327 


.4123 


.4189 


,4450 




4. R-105 63 Soo. Stud. 




. ^256 


.611 7 




.6202 


.6931 


.5966 


.4931 


.4465 


.44 19 


. 3980 


.5260 




5. R-lOb 63 Mnth 


.0b92 


• 6555 


.5541 


.6202 




.7194 


.5349 


.4404 


84461 


.4745 


.396 7 


.4551 




6. R-107 63 Phya. Scl. 


.7l^J 


.66?f 


.595 7 


.69 11 


• 7194 




.6346 


.4694 


.5241 


.5931 


.4960 


.5194 




7. R-108 63 lUo. Scl. 


• 6009 


• 5930 


.5151 


.5966 


.5349 


.6146 




843 1 3 


.4491 


.42 79 


.4474 


.5091 




8. R-109 63 Sciont.Atc 


• »i6b0 


• 4H9 S 


.4544 


.4911 


• 4404 


.4695 


.431 3 




.3001 


.3295 


.3861 


• 4 160 




9. R-110 63 Anro-Spaca 


• <>990 


• 546f 


.432 7 


.4465 


.4401 


.5241 


.4491 


.3001 




.4603 


.4446 


.1757 




10. R-111 63 Electronic 


• 4600 


.41 f(, 


.4121 


.44 19 


.4745 


.5931 


.4279 


.1295 


.4603 




• 4943 


.4009 


u 


11. R-112 63 Mechanica 


.b091 


• 19 n 


.4109 


. 190H 


. 1967 


.4960 


.4474 


. 3061 


.4446 


.4943 




.5400 


5 


12. R-113 63 Farming 




• 504f 


• 4450 


.5260 


.4151 


.5194 


.5091 


• 4160 


. 3737 


.4009 


. 5400 




H 


13. R-114 63 Home Ec. 


• <♦701 


.3002 


.400 1 


.4167 


. 1490 


.4005 


.4 106 


• 3605 


.3161 


.325 7 


• 4576 


• 4 6H4 


s 


14. R-U5 63 Sporta 


• ‘><777 


• 512? 


.5171 


.5209 


.5029 


.5024 


.4217 


.3964 


.4061 


.352 1 


.3927 


.‘>157 


U 


15. R-131 63 Art 


• 6636 


• 6266 


• 5640 


.5/63 


.4407 


.5227 


.4070 


.4513 


.4125 


.2990 


.4460 


.4 595 


1 


16. R-132 63 Uw 


• ^029 


.569 3 


• 52H9 


.5 759 


.4272 


.4013 


.4350 


.4337 


.4349 


.3609 


.4445 


.4509 


i2 


17. R-133 63 Health 


.6639 


.5312 


.5000 


.515? 


.3900 


• 4 767 


• 4493 


• 4143 


.3562 


.3114 


.4192 


.40 5H 


44 

M 


18. R-134 63 Eng In. 


.<><•66 


• 3922 


.407 1 


. 174 1 


. 3552 


.4326 


• 1711 


.3601 


.3169 


• 1502 


.4484 


.44( 1 


H 


19. R-135 63 Arch. 


• <720H 


.4297 


.4190 


• 4193 


• 3150 


.4224 


.195 7 


.2005 


. 3001 


. 1501 


.3217 


. 5147 




20. R-138 63 Military 


• <•<•3 ) 


.4407 


• 4190 


.4 765 


• 3056 


.3012 


.3043 


.2534 


.2964 


*3149 


.2852 


.2715 




21. R-139 63 Acct.Buai. 


• 6013 


• 5520 


.5540 


• 6165 


.4495 


.4 799 


. 1 794 


.4298 


• 3660 


♦2016 


. 3973 


.4675 




22. R-140 63 Proc.Knowl 


• <»<»0t 


• 4260 


• 4010 


• 4103 


.2906 


.3305 


.296 3 


. 1477 


.2320 


.2504 


.3097 


. 3062 




23. R-142 63 Bibla 


.b2li 


.5573 


.4702 


.5299 


. 1075 


.5019 


.4356 


.3597 


.3157 


.3396 


. 3580 


. 5940 




24. R-14S 63 Hunting 


.1160 


.0530 


.0402 


.1212 


.054 7 


.1527 


.160 7 


.0252 


.1114 


.2095 


.2541 


.2470 




25. R-146 63 Fiahing 




.04 74 


.(^760 


.04 59 


.0225 


.0721 


.1 160 


.0594 


.0933 


• 1896 


.2190 


.0960 




26. R-147 63 Outdoor 


• b3i0 


.4997 


.4633 


.4946 


.4 704 


.4706 


.4347 


. 3769 


• 3048 


. 3305 


• 3850 


. 5912 




27. R-150 63 Theater 


.6726 


.6310 


• 6106 


• 6014 


.5436 


• 5301 


• 4655 


.4599 


• 4 366 


.2809 


• 3873 


.4164 




28. R-162 63 Vocab. 11 


.6939 


.6173 


.5925 


.64 19 


.5127 


.5657 


.5007 


.4730 


.4297 


.3153 


• 4265 


.5099 




29. R-212 63 Mem. Worda 


.<•239 


.4022 


• 3704 


• 4054 


.4 101 


.15 12 


. 3035 


.2576 


.2272 


• 2304 


• 2035 


.2655 


U 


3d. R-220 63 Disg. Wda. 


• S|2<7 


• 465? 


.4406 


.4097 


• 46 75 


.<•635 


• 1029 


. 353? 


.2049 


.3215 


.2763 


. 2924 


8 


3T; R-231 63 Spelling 


.<•<•72 


.4707 


. 1502 


• 4064 


. 39 30 


. 1291 


.2924 


.24 39 


.1175 


.20 71 


. 1654 


.2010 


H 


32. R-232 63 Capital. 


• 30H<» 


.3292 


.2569 


.3022 


• 2560 


.2025 


.2206 


• 1005 


• 1456 


.1600 


.1702 


.2060 


t 


33. R-233 63 Punct. 


.5 700 


.6223 


.490 7 


• 5661 


.5752 


• 5046 


.4200 


• 3043 


.2252 


• 2026 


• 2060 


.4191 


-i 


34. R-234 63 Eng. Uaaga 


• bOOO 


.5090 


. 1766 


.4564 


.4055 


.4249 


.3594 


.3576 


.2643 


.2756 


• 2382 


.4026 


1 


3^. R-235 63 Eff. Exp. 




• 4412 


. 106 1 


.43 75 


• 4503 


.4066 


. 3504 


• 3962 


.2031 


.2551 


.2752 


. 3026 




36. R-240 63 Word.Funet 


• 5639 


.5610 


.4962 


.5777 


.5965 


.5507 


.4663 


• 4445 


• 3616 


.30 39 


• 3441 


• 4204 




37. R-250 63 Rdg. Compr 


.700 7 


.6940 


.6206 


. 7034 


.5030 


.62 39 


.5623 


.5739 


• 4671 


.4130 


• 4635 


. 55 76 




36. R-260 63 Creativity 


.57<»2 


.52 7 1 


.4 342 


.4725 


.5109 


.51 1 7 


• 4970 


• 44 14 


• 4 306 


.4030 


• 4522 


.4 360 




39. R-270 63 Mech.Reau 




• 4234 


• 4246 


.4200 


.5339 


.5455 


• 4 79 1 


.3889 


• 4694 


.4157 


.4331 


. 3902 




40. R-2B1 63 Via. 2 Dim 


• 29B2 


.2413 


• 2146 


.24 7b 


. 3309 


.3109 


.2050 


.2162 


.2504 


.2505 


.2428 


.2602 




41. R-282 63 Via. 3 Dim 


.<•605 


.3 765 


.359 7 


• 1602 


.4403 


.45 36 


.4099 


.3705 


. 3845 


.3600 


.4073 


. 3494 




42. R-290 63 Abat.Raaa 


• 50<»7 


.4495 


• 4196 


• 4504 


.4699 


.4697 


.3071 


.4226 


• 3160 


• 20 70 


.3387 


.3715 


as «a 


TsT R-311 63 Arith. Rcaa 


.62<»9 


.54 79 


.4066 


.5030 


.6514 


• 5802 


.4625 


.4620 


.2940 


• 1010 


• 3802 


• 4064 


♦« m 

A A 


44. R-312 63 Int.HSHcth 


.5539 


.5 754 


.5075 


.5006 


.0310 


.6332 


.4 751 


.4039 


.3100 


.4403 


.3247 


. 5026 


m H 


45. R-333 63 Adv.HSMath 


. J76<» 


.4116 


. 350 1 


.3911 


.6756 


.5020 


. 1105 


.2491 


.2720 


• 1206 


.2121 


.2256 




4b. F-410 63 Arith. Comp 


.3939 


• 2992 


• 3209 


. 34 75 


. 3035 


.3210 


.2126 


.2779 


.1340 


.2703 


.2551 


. 322S 




47. F-420 63 Tablt Read 


• 2016 


. 1920 


• 1002 


• 2145 


• 2392 


.2637 


.1632 


.2272 


. 1866 


.1662 


• 176 7 


. 1614 




48. F-430 43 Clar.Chaek 


• 2560 


. IHH 7 


.1292 


.2110 


.2625 


.2350 


.1049 


• 1362 


. 1635 


.1949 


• 1298 


.1339 




ObJ.Inao. 


• 3061 


.2127 


.2240 


.2001 


.2516 


.2796 


.2411 


.2010 


.2395 


.2545 


• 2854 


• 2152 




So. R-102 60 Vocab. I 


. 7569 


• 66 76 


.6329 


.6516 


.6034 


.7>594 


.5779 


.4918 


.4655 


.4616 


• 4570 


• 5107 




51. R-103 60 Littratura 


.6150 


• 7143 


.5726 


.5979 


.5452 


.5655 


.4 771 


.4157 


. 38 31 


.3705 


.3293 


.3799 


Jf 


52. R-104 60 Music 


• 6062 


.5902 


.7367 


.5029 


.5253 


.5515 


.4536 


.3922 


. 3863 


.3005 


• 3736 


.3951 




S3. R-IOS 60 Soe. Scud. 


.6919 


• 6051 


.6110 


. 7924 


• 6102 


.6645 


^-5681 


.4602 


.4006 


.43 39 


.3836 


.4737 




54. R-106 60 Math 


.5750 


.5646 


.5004 


.5445 


.6040 


.5917 


• 4708 


. 3757 


. 3630 


.3500 


• 3333 


. 37 77 




55. R-107 60 PV:ya. Scl. 


.5929 


.5504 


.4793 


.5040 


.5446 


. 7066 


.5200 


.3 796 


. 3930 


.4524 


.3648 


.4044 




56. R-108 60 Bio. Sci. 


.5200 


.5166 


.4514 


.5105 


.4615 


.5490 


• 6169 


.3919 


. 3507 


. 38 39 


.4017 


.4706 




57. R-109 '60 SeianC.AcC 


.5010 


.4463 


.4144 


.4439 


.396 3 


.4309 


.3062 


.5155 


.3096 


.2976 


. 3289 


.3922 




58. R-110 60 Atro-Spaea 


.4036 


.3895 


• 1565 


.3721 


• 3005 


.4313 


.3414 


.2/37 


.4 732 


.3212 


.2 793 


.2474 




59. R-111 60 Eltecronie 


.3602 


.3242 


.2010 


. 1395 


. 3435 


.4200 


.3101 


.2320 


.2740 


.4572 


• 3019 


.2073 


u 

m 


60. R-112 60 Mtehaniea 


• 4 3b 7 


• 3560 


• 3609 


.3576 


. 3475 


.4104 


• 3900 


.3005 


.3400 


. 37 76 


.5746 


.4471 


fi 


61. R-113 60 Farming 


• 54Bf 


.4063 


.4378 


*>5022 


.4240 


.5119 


.5003 


.3875 


.3 768 


.3040 


.5096 


.6093 


c 


62. R-114 60 Home Ee. 


.4753 


.42 35 


• 4254 


.4211 


.3975 


.4200 


• 4102 


. 3007 


. 3037 


.3227 


• 4180 


.4354 


5 

•H 


63. R-llS 60 Sports 


.4696 


.4664 


.4647 


.4756 


.4667 


.4410 


.3531 


.3344 


.3341 


.20 79 


.3469 


. 3932 


% 


64. R-131 60 Art 


• 6363 


.6120 


.5692 


.5661 


.5034 


.5250 


.4093 


.4331 


.3854 


• 3540 


. 3920 


.4253 


e 


65. R-132 60 Law 


• 4509 


.4391 


• 3904 


.4220 


.3794 


.4169 


.3567 


.3398 


. 3250 


.2978 


.3135 


. 3371 


& 


66. R-133 60 Health 


.5619 


• 5300 


.4908 


.5250 


.4400 


.5072 


.4743 


.4023 


. 3424 


.3342 


. 3600 


.4074 


A 


67. R-134 60 Engin. 


.4244 


.3507 


.3045 


.3590 


.3379 


r 3719 


.3596 


.3165 


.2752 


.3259 


.3612 


.3400 




68. R-135 60 Arch. 


• 3570 


.3413 


.3111 


, 3433 


.3042 


.3160 


.2682 


• 2001 


.2210 


.2275 


.2100 


.2614 




69. r- 138 60 Military 


.29^0 


.2724 


.2040 


• 2960 


• 2040 


.2729 


.2197 


.1785 


• 1891 


.2036 


.2052 


.19/0 




70. R-139 60 Aeec.Busi. 


.5415 


.5160 


.4570 


.5120 


.4 744 


.4 792 


.3974 


.3659 


. 3253 


.3267 


• 3285 


• 3 780 




71. R-140 60 Prae.Knowl 


.4313 


. 3057 


. 3532 


.4017 


.3356 


.3525 


.3166 


.3825 


• 2501 


.2290 


.2799 


• 2002 




72. R-142 60 Bible 


• 4001 


.5256 


^4322 


.5002 


.4251 


• 4590 


.4225 


.3596 


.3104 


.3050 


.3185 


• 4056 




73. R-145 60 Hunting 


.1073 


• 0396 


• 0514 


.0936 


.0660 


.0991 


.0058 


.0484 


.0890 


.0959 


. 1426 


• 1376 




74. R-146 60 Fiahing 


• 0537 


.0566 


.0555 


• 0502 


.0611 


.0606 


.0940 


.0431 


• 0595 


.0509 


.0762 


.0646 




75. R-147 60 Outdoor 


.5313 


.4607 


.4771 


.4695 


.4394 


.4722 


.4120 


.3925 


.3521 


.3109 


.3440 


. 3749 




76. R-150 60 Theater 


• 5004 


.5712 


.5207 


.5153 


.4708 


.4616 


. 3004 


.3744 


.362 7 


• 3031 


.3148 


. 3726 




2Zs R-162 60 Vocab. II 


.6650 


.6242 


• 5013 


.6076 


.5394 


.5691 


.5045 


.4713 


.3808 


.3606 


.4083 


.4604 




78. R— 212 60 Mem. Words 


• 4400 


.4434 


• 304 3 


• 4343 


• 4216 


• 4146 


.3415 


.301T 


• 2373 


.2514 


.2418 


• 2796 


W 

• 


^ R-220 60 Diag. Wda. 


• 5463 


.4923 


.4910 


.4606 


.4541 


.4460 


• 4 102 


.3671 


.2888 


.2789 


• 2950 


.3562 


» 


80. R-231 60 Spelling 


• 4504 


^4425 


.3041 


.4126 


.4203 


.4019 


.3120 


.2939 


.1956 


.2434 


.2052 


.3037 


4S 


81. R-232 60 Capital. 


. 3500 


.3428 


.2997 


. 3373 


• 2806 


• 2910 


.2452 


.2536 


.1770 


.1047 


• 2159 


.2075 


5 


82. R-233 60 Punct. 


.5600 


.5653 


.5022 


.5566 


.5623 


• 5i:>22 


.4451 


.4349 


.3246 


.3492 


. 3341 


.4363 




83. R-234 60 Eng. Usage 


.4802 


• 4764 


.4002 


.4421 


.4054 


• 40 7 1 


.3292 


. 3456 


.2558 


.2793 


.2849 


. 3504 


l< 


84. R-235 60 Eff. Exp. 


• 4296 


.4309 


. 3690 


. 1916 


.3832 


.3031 


• 3212 


.3521 


.2371 


.2400 


• 2362 


• 2863 




BS. R-240 60 Word.Funet 


• 5534 


.5541 


• 4400 


.5235 


.5903 


.5315 


.4360 


.4110 


. 3325 


.3269 


• 2871 


.3765 




86. R-250 60 Rdg. Compr 


. 7369 


.70 39 


.6220 


• 6927 


• 6161 


.6526 


.5909 


.5366 


.4476 


.4142 


.4434 


.5320 




87. S-260 60 Creativity 


.5325 


• 4732 


.4544 


.45^7 


.4754 


.4937 


.4620 


.3913 


.3707 


• 3671 


.4274 


.4063 


88« R-270 60 Mech.Reas 


• 4069 


.3966 


.4034 


• 4080 


• 4605 


• 5047 


.4169 


.3799 


• 416< 


.3817 


.4232 


. 3774 


89. R-2B1 60 Via. 2 Dim 


.3365 


• 2916 


* ^2709 


• 3033 


• 3550 


.3291 


• 2508 


.3213 


.2512 


.2414 


.2893 


• 3036 




90. R-282 60 Vis.' 3 Dim 


• 3901 


.3403 


• 3240 


.3593 


.4131 


• 4136 


• 3 359 


. 3384 


.3050 


.3010 


.3199 


• 2962 


91. R-290 60 Abat.Reas 


• 5066 


• 4298 


.4272 


.4497 


.4921 


.4008 


.4003 


.4072 


.3311 


.3123 


• 3320 


• 3510 


•e tfr 


92. R-311 60 Arith. Reaa 


• 6009 


.5363 


• 4004 


.5616 


.5945 


• 5871 


.4572 


• 4488 


. 3666 


.3752 


.3902 


.4393 


If 


93. R-312 60 Int.HSHath 


.5779 


.5624 


.4700 


.5543 


.6666 


.5851 


.4399 


.4122 


.3711 


• 3684 


• 3520 


• 3070 


■*TWj R-333 60 Adv.HSMath 


• 1172 


.0053 


• 1026 


U.0977 


.1597 


.1306 


. 1057 


.1159 


• 0802 


• 1010 


.0861 


• 064 7 


95. F-AIO 60 Arith. Corap 


. 3200 


.2944 


• 2914 


• 3096 


.3190 


• 2050 


.2332 


.2325 


• 1691 


.1902 


.1677 


.2333 


96. F-420 60 Table Read 


• 2040 


.2005 


.1806 


.1715 


.1059 


.1767 


» 1 160 


.1798 


.1329 


• 1304 


.1474 


. 1 734 


97. F-A30 60 Cler. Check 


• 1053 


.1972 


• 1622 


.1664 


• 1904 


.1637 


.1237 


.1376 


• 1009 


• 0090 


*0636 


• 1438 


98. r-460 60 ObJ.lnap. 


• 2142 


• 2016 


• 2041 


.1736 


• 2296 


.2022 


.1 722 


• 1967 


.1504 


• 1390 


.1586 


. 1656 


99. P*801 60 Socioeeon. 


.4079 


.4200 


.4474 


• 3041 


.4059 


.3535 


• 2824 


.3001 


.2562 


.2022 


• 1872 


.2015 



o 

ERIC 



T 






1 






6-13 

table 6-lb (continued) 



j 



i 



'( 



I 



■( 



f 



;.i 



i 




1) 

.4701 

. 380 ? 

.4083 

.4167 

.3498 

.4086 

• 4 1 86 

• 3686 
.3161 
.3267 
.4676 
.4684 

.3627 

.4182 

.3786 

.4340 

.4063 

.2724 

.2607 

.4678 

• 2960 
.3103 
.2014 

• 0691 
.3903 
.3866 
.4703 
. 1816 
.1809 
.1821 
. 1914 
.2797 
.2637 
.3228 
.3063 

• 4316 

• 3442 

• 3124 

• 1901 

• 3487 
.3646 

• 3880 
.3163 
. 1662 
.2407 
.0779 

• 0140 
.1164 
.4106 
.3220 
. 3790 
. 3830 
.3268 
.3242 
.39/7 
. 3342 

• 2220 
.2368 
. 3749 
.4460 
.6432 
.3264 
.3600 
.2794 
.3728 
.3184 
.2403 
. 1609 
.3145 
.2821 

• 3216 
.0822 
.0661 
.3666 
.3086 

• 3983 
.2206 
.2604 
.1989 
.2226 
.3186 
.26/6 
. 2 7 .30 
.2633 
.4138 
.3600 
. 3300 
.26/9 
.2962 
.3176 
.3467 
.3180 
.0663 
.1893 
.1461 
.0696 
.1595 

• 18/0 



.5477 
.6127 
.6171 
.6289 
.5029 
.5Q2<» 
.4217 
.3964 
.4061 
. 3621 
.3927 
.4167 
.362 7 

• 4262 

• 4669 
. 391 / 
.2931 
.3445 
.3491 

• 4412 
.3432 

• 2964 

• 0809 

• 0646 
.4240 
.4979 

• 4401 
.3316 
. 3 / 8 / 
.3014 
.2486 
.422 / 
.3481 
. 3352 

• 4028 
.4365 
.4328 
.3392 
.2413 
.2729 
. 3733 
.4543 
.4316 
. 3333 
.2923 
.2070 

• 1/15 
.2103 
.5099 

• 4263 

• 4966 
.6205 

• 4140 
.4186 
. 3735 
.3195 
. 3009 
.2466 

• 3149 
. 3799 
.3890 

• 6066 

• 4393 
. 3586 
.3597 
. 3016 
.2701 

• 2486 
.3581 

• 3140 
.2955 
.0630 
.0961 
.4079 

• 4378 
.4274 
.3216 
. 3 796 
. 3053 

• 2636 
.3922 
. 3006 
.2714 
.3808 
.4987 
. 3669 
.3508 
.2727 
.2752 

• 3378 

• 3829 
.4227 

• 1087 
.2677 
.1817 
. 1454 
. 1848 
. 3398 



16 

• 6636 
.6266 
.5648 
.5763 

• 4487 
.6227 
.4878 

• 4513 
.4125 
.2998 
.4486 
.4595 

• 4182 

• 4262 

.5129 

.6099 

• 3781 
.4526 

• 3986 
.4802 

• 4299 
.4532 

• 0514 

• 1069 
.4 700 

• 6300 
.5960 

• 4142 
.4210 
.3936 

• 3041 
.4100 
.3932 

• 4007 

• 4303 
.6593 

• 4514 

• 3617 

• 1824 

• 2994 
.4419 
.4597 
.4262 
.3747 

• 2788 
.2335 
.0786 

• 1716 
.6012 
.596/ 
.5522 
.59 79 
.4524 
.4923 

• 4449 

• 4205 
.3201 
.2583 
. 3547 
.4633 
.3945 

• 4111 
.66 /5 
.4001 

• 4869 
. 3389 
.3201 
.2667 

• 4368 
.4166 

• 4268 
.0732 
.0710 
.4459 
.5481 
.5761 
. 3293 
.4386 

• 3466 
.4075 
.4573 

• 4255 
.3602 
.4266 
.6220 
.4477 
.3941 
.2798 
.29/7 
.4082 
.4111 
.4512 

• 0G14 

• 2424 

• 1665 
.1432 
.1570 
. 3930 



16 

.5829 
.5693 
' .6289 
.5769 
.4272 
.4813 

• 4358 
.4337 

• 4349 
.3609 

• 4445 
.4589 
.3786 

• 4669 
.5129 

.4279 

• 3496 
.3610 
.3995 

• 4890 

• 3672 

• 4442 
.0869 

• 0947 
.4093 
.5221 

• 5468 

• 4019 
^ .2739 

• 3637 

• 3073 
.4333 
. 3637 
. 3489 

• 4786 

• 6921 
.4010 
.3103 

• 1109 

• 2742 

• 4028 
.4867 
.4209 

• 3444 
.2606 
.1238 
.1297 
.0912 
.5374 
.4674 

• 4643 
.5614 
.4496 
.4428 

• 4162 
.4053 
. 3074 
.2453 
. 3579 

• 4655 

• 3927 
.4009 
.4512 
.4436 
.4131 
.3202 
.2725 
.2872 
.3919 
. 3295 
.3 709 
.0602 
.0443 
.3920 
.4333 
.4717 
.2839 
.3662 
.3089 
.3737 
.4577 
.3752 
. 3395 

• 4013 
.5643 
.3912 
. 3374 
.2113 
.2832 

• 3683 
.4628 

• 4338 
.0534 
.2414 
.1528 
.1296 
.1169 
.3032 



1 7 

.5639 

• 6312 
.5080 
.5152 

• 3968 
.4767 

• 4493 

• 4U3 
.3562 
.3114 
.4192 

• 4838 
.4340 
.3917 
.5099 
.4279 

• 3343 
.32 76 

• 3347 

• 4210 
.3943 
.4278 
.0814 
.0759 
.3930 
.4934 
.5521 
.3424 
.3056 
.3521 

• 3591 

• 401 / 
.4^»23 

• 3165 

• 4149 
.5332 
.3401 
.2402 
.1641 
.2973 
.3730 
.4097 
.3997 
.3013 
.2709 
.3287 
. 151 / 

• 2200 
.5158 
.4509 
.4326 
.4904 
.3945 
.4359 
.4111 
.3812 

• 284/ 

.2220 

• 2950 
.4286 
. 3684 
.3556 
.4605 
. 3329 
.5462 
.3142 
.2556 
.2228 
.3338 
.2952 

• 3880 
.0673 

• 0478 
.3779 
.4009 
.4770 

• 3014 
.3954 
.3311 
.3798 
.4282 
.3688 
.3182 
.3692 
.5287 
.3560 
.3104 
.2264 
.2595 
.3584 
.3830 
.4058 
.0746 
.2854 
.2170 
.1160 
.16 38 
.2599 



18 

• 4466 
.3922 
.4073 

• 3/<»3 

• 3552 

• 4326 
.371 1 

• 3601 

• 3189 

• 3582 
.4484 
.4401 

• 4053 

• 2931 

• 3781 

• 3496 

• 3343 

.2441 
.2478 
. 3199 

• 3034 

• 3176 
. 1543 
.1249 
.3569 

• 3678 

• 3541 

• 2006 

• 1289 
.2075 

• 1588 
.2404 
.2222 
.2192 

• 2878 
.372 7 
.2397 
.2375 

• 1959 
.2557 
.2972 
.3063 
.2493 
.23/4 
.1308 
. 1 125 
.0835 

• 1999 

• 3652 
.2752 
.3138 

• 3495 

• 3265 
. 3486 
. 3037 
.2969 
.2084 
.2023 
.2987 

• 4035 

• 3433 
.2450 

• 3340 
.2345 
. 3504 
.4117 
.1761 
.1645 
.2285 
.2530 
.2577 

• 1173 
.0387 
.3142 
.3080 
.3328 
. 1914 

• 2 726 
.2079 
.2536 
.2937 

• 2450 
.2104 

• 2564 
. 3770 
.2979 
.2914 
.2181 
.2357 
.2669 
. 3004 
.2972 
.0787 

• 1591 
. I 325 
.0812 
.0972 
.2069 



19 

• 4208 
.4297 
.4190 
.4193 
.3350 
.4224 
.3957 

• 2805 

• 3001 
.3501 
.3217 
.3147 
.2724 

• 3445 

• 4525 
.3610 
.3276 
.2441 

• 2971 

• 3144 
.25 79 

• 3400 

• 0639 

• 1024 
.3127 

• 4058 

• 3650 
.3312 
.2610 
.3207 
.2174 

• 3441 
.3239 
.2892 

• 3538 

• 4540 
.2970 
. 1994 
.0952 

• 2390 
.2932 

• 3667 

• 3786 
.3603 
. 1947 
.1221 
.1009 

• 0875 
.4802 

• 4627 

• 4246 
.4607 

• 4041 
.3890 
. 3332 
.2831 
.2523 
.2572 
.2568 
.3267 
.3115 
.3172 
.4092 

• 2824 

• 3658 
.2708 

• 3594 
.2015 
.3297 
.25 88 

• 3236 
.0215 

• 0196 
.3457 

• 3984 
.3924 

• 2635 
.3239 

• 2939 

• 2769 

• 3663 

• 3089 
.2556 
.3915 

• 4482 
.3212 
.2645 
.1340 
.2146 

• 2988 
. 3320 

• 3446 

• 0674 

• 1850 

• 0851 
.1438 

• 0831 
.30 39 



20 

• 4433 

• 4487 

• 4190 
.4 765 

• 3056 
.3812 
. 3043 
.2534 
.2964 
.3149 

• 2852 

• 2715 
.2507 
.3491 
. 3986 
.3995 
. 3347 
.2478 

• 2971 

.3200 

• 2591 

• 3282 

• 0883 
.0097 

• 2904 

• 3878 
. 3683 

• 3276 
.2139 
.2877 

• 2539 
.3327 
. 3020 

• 3051 
.3278 
. 3957 
.3467 
.3138 

• 1388 
.2377 
.2555 

• 3170 
. 3544 
.3101 
.2223 
.1001 
.1103 
. 1085 

• 4426 
.3933 
.4163 
.4497 
. 3683 
. 3324 

• 2982 

• 2986 

• 2699 

• 1936 
.2658 
.2844 
.2510 
^3122 
.3388 

• 2821 
.3110 
.2078 

• 2340 

• 3388 
.3071 

• 2504 
.3063 
.0587 
.0248 

• 2661 

• 3416 
.3569 
.2264 

• 2944 
.2566 

• 2545 

• 3282 

• 2852 

• 2224 

• 2968 
.4029 
.2397 
.2728 
.1558 

• 1705 
.2651 
.329 7 

• 3150 

• 0370 
. 1564 

• 1104 

• 0928 

• 0810 
.2633 



21 

• 6013 
.5520 
.5540 

• 6165 
.4495 
.4799 
.3794 
.4298 

• 3860 

• 2818 
.39/3 
.4675 
.4578 
.4412 
.4802 

• 4H90 
.4210 
.3199 

• 3144 
.3200 

• 3768 

• 3546 
.0629 
.0752 
.3691 
.5109 
.6174 
.31 19 
.3102 

• 3228 
.2527 
.4467 

• 3314 

• 3738 

• 4334 
.5477 

• 4087 
.32 52 
.1851 
.2872 

• 4217 
.5506 
.4330 
.2922 
.3581 
.2014 
.1461 
.1276 
.5313 

• 4502 
.4725 

• 5126 

• 4389 

• 4310 
.356 7 

• 3818 
.2700 
.2410 
.3289 

• 4390 
.3807 

• 3685 
.4447 

• 3703 
.4311 
.32/1 

• 2686 
.2529 

• 5194 
.3622 

• 3308 
.0639 

• 0586 
.3836 
.4580 

• 4974 
.2797 

• 3722 

• 3260 

• 3936 
.4484 
.3586 
.3304 

• 3968 

• 5155 

• 4036 
.3283 

• 2501 
.2750 
.3617 
.4916 
.4421 

• 0746 

• 3140 
.1635 
.1032 
.1037 
.2811 



22 

• 4401 
.4260 
.4010 

• 4183 
.2906 

• 3305 

• 2963 
. 3477 

• 2320 
.2504 
.3097 

• 3062 

• 2960 

• 3432 
.4299 

• 3672 
.3943 
.3034 
.2579 
.2591 
.3 768 

.3007 

.0444 

• 0510 

• 3486 

• 4132 

• 3897 
.2674 
.2018 
.2762 

• 2487 

• 3205 

• 2500 
.2386 

• 3463 

• 4343 

• 2693 
.2138 
.1085 
.2171 

• 3235 

• 295 7 

• 2938 
.2234 
.3003 
.2185 
.0802 
.1700 

• 3730 
.3275 

• 3356 

• 3634 
.2970 

• 2868 

• 2676 

• 3206 

• 1994 
.1557 

• 2185 
.2844 

• 2978 

• 3039 

• 3644 

• 2588 
.3100 

• 2493 
.2130 

• 2099 

• 2857 

• 4285 
.2939 
.0314 

• 0462 
. 3363 

• 3294 

• 3700 

• 2076 

• 3095 
.2233 

• 2925 
.3260 
.2667 

• 2465 
.2911 

• 3786 
.2658 
.2477 
.2093 
.2090 

• 2695 
.3052 

• 3140 

• 0939 
.2435 
.1751 
.1343 
.1262 
.2496 



23 


24 


25 


Variable 




.lion 


.0558 


1. R-102 


63 


.55/3 


.0538 


• C474 


2. R-103 


63 


.478? 


.0402 


.0 760 


3, R-lOA 


63 


.529) 


• 1212 


.045) 


4. R-IOS 


63 


.3H/5 


.0547 


.0225 


5. R-106 


63 


.5039 


.1527 


.072 1 


6. R-107 


63 


.4356 


.1607 


.1160 


7. R-lOB 


63 


.3597 


.0252 


• 0594 


a. R-109 


63 


.315/ 


.1114 


.0933 


9. R-110 


63 


.3396 


• 20)5 


• 1896 


10. R-111 


63 


.3580 


.2541 


• 2198 


11. R-112 


63 


.39<»H 


.24/8 


.0968 


12. R-113 


63 


.3103 


• 2014 


.0691 


13. R-114 


63 


• 2964 


.0609 


.0646 


14. R-llS 


63 


• 4532 


• 0514 


• 1069 


IS. R-131 


63 


.44^f2 


.0869 


.0)4 / 


16. R-132 


63 


• 42 79 


.0814 


.0759 


17. R-133 


63 


.3176 


.1543 


.1249 


18. R-134 


63 


.3400 


.0639 


.1024 


19. R-13S 


63 


. 3282 


.0883 


.0897 


20. R-13B 


63 


• 3546 


.0629 


.0752 


21. R-139 


63 


. 3U87 


• 0444 


.0510 


22. R-140 


63 




. 1101 


.0719 


23. R-142 


63 


.1101 




.0)69 


24. R-14S 


63 


.071) 


.0969 




25. R-146 


63 


.3310 


.0818 


• 1165 


26. R-147 


63 


.4118 


.0555 


.0759 


27. R-150 


63 


.4343 


.0699 


.0680 


26. R-162 


63 


.4105 


.0680 


.0845 


29. R-212 


63 


.2805 


.0263 


.0024 


30. R-220 


63 


.3008 


.0413 


• 1189 


31. R-231 


63 


.2537 


• 0462 


-.0193 


32. R-232 


63 


.3682 


.01 78 


• 0961 


33. R-233 


63 


.3902 


-.02/8 


.0928 


34. R-234 


63 


.3490 


• 0309 


• OlH2 


35. R-235 


63 


• 4421 


.0324 


-.0141 


36. R-240 


63 


• 5894 


.0852 


• 0601 


27. R-250 


63 


. 3494 


.0618 


.1292 


3B. R-260 


63 


.2695 


.0759 


.0559 


39. R-270 


63 


.1681 


.0184 


.0692 


40. R-2B1 


63 


. 3419 


.0313 


.0499 


41. R-282 


63 


.3415 


.0600 


• 08/6 


42. R-290 


63 


.4309 


.0398 


.0821 


43. R-311 


63 


.3803 


.0268 


.0/56 


44. R-312 


63 


.2891 


-.0027 


.0939 


45. R-333 


63 


.2836 


.0574 


.0756 


46. F-410 


63 


. 1848 


.0335 


• 0522 


47. F-420 


63 


.0419 


• 06 34 


.0876 


48. F-430 


63 


.0702 


• 0104 


.0306 


49. F-440 


63 


.4883 


.0720 


.07/1 


SO. R-102 


60 


.4707 


.0620 


• 0605 


51. R-103 


60 


.3980 


.0395 


.0561 


52. R-104 


60 


.5124 


.0990 


.0446 


53. R-105 


60 


.3815 


• 0348 


.0762 


54. R-106 


60 


.4042 


.1054 


.0628 


55. R-107 


60 


.3829 


.1087 


.1149 


56. R-loe 


60 


. 3748 


.0833 


• 0435 


57. R-109 


60 


.2651 


.0596 


.0979 


SB. R-110 


60 


• 2249 


• 07/7 


.0925 


59. R-111 


60 


.2609 


• 1589 


.1651 


60. R-112 


60 


. 3875 


.1769 


.1074 


61. R-113 


60 


.2805 


• 1012 


.0759 


62. K-114 


60 


.2647 


.0365 


.0870 


63. R-llS 


60 


.3910 


• 0345 


.0642 


64. R-131 


60 


. 3308 


.0350 


.0233 


65. R-132 


60 


.3668 


.0429 


.0477 


66. R-133 


60 


.2433 


.0629 


.0965 


67. R-134 


60 


.2554 


• 0397 


• 0438 


69. R-13S 


60 


.2500 


.0418 


• 0445 


69. R-138 


60 


• 33/0 


.0307 


.0271 


70. R-139 


60 


.2677 


.0072 


-.0096 


71. R-140 


60 


.7623 


.0/24 


«0242 


72. R-142 


60 


.0581 


.2394 


.0/22 


73. R-145 


60 


.0200 


.0525 


.23/7 


74. R-146 


60 


.3030 


.0007 


.1024 




a 


. 3232 


.0102 


• 0503 


/«. R— 150 


60 


• 4325 


.0055 


.0457 


77. R-162 


60 


.2 769 


• 0299 


-.0023 


78. R-212 


60 


. 3224 


.0342,- 


.0560 


79. R-220 


60 


.2745 


• 048 3" 


.0315 


80. R-231 


60 


• 3082 


.006/ 


.0386 


81. R-232 


60 


.4083 


.0631 


.0433 


82. R-233 


60 


.3157 


.0328 


.0538 


83. R-234 


60 


. 3109 


.0218 


.0405 


B4. R-235 


60 


. 3924 


.0200 


.0266 


85. R-240 


60 


.5527 


.0581 


.0680 


86. R-250 


60 


• 3438 


.0522 


.09C8 


B7. R-260 


60 


.298 7 


.0803 


• 1013 


88. R-270 


60 


.1814 


.01 34 


.0719 


89. R-281 


60 


.2502 


• 0248 


• 0521 


90. R-282 


60 


• 3273 


• 0425 


.0639 


91. R-290 


60 


. 3976 


.0629 


.0303 


92. R-311 


60 


.4049 


.0185 


.0414 


93. R-312 


60 


.C546 


.0323 


• J444 


94. R-333 


60 


.1865 


.02 79 


• C109 


95. F-410 


60 


.1326 


• 0391 


.0065 


96. F-420 


60 


.0716 


.0198 


.0223 


97. F-430 


60 


.0646 


.0263 


.0196 


98. F-440 


60 


• 1608 


-.0500 


-.0102 


99. r*801 


60 













TABLE 6-lb (continued) 





Variable 


26 


27 


28 


29 


30 


31 


32 


33 


14 


i 5 


36 


3/ 




X U-102 63 Vocab. X 


.5310 


.6726 


.6939 


.4239 


.5124 


.4472 


. 30H4 


.5708 


• bOCO 


.4 565 


. 56 39 


• fOOf 




2. R-103 63 Literature 


.4997 


• 6318 


.6373 


.4022 


• 4859 


.4707 


.3212 


• 6223 


.5090 


.44 12 


.5618 


.6948 




3. K-104 63 Music 


• 4633 


.6186 


.5925 


• 3/84 


• 4406 


. 3502 


.2569 


• 4907 


• i766 


. 3861 


.4 162 


• 62 i»6 




4. R-105 63 Soc. Stud. 


.4946 


• 6014 


.64 39 


• 4054 


.4097 


• 4064 


. 3022 


• 566*3 


.4564 


.43/5 


. 5 / / 7 


. /034 




5. R-106 63 Math 


.4704 


.5436 


.5327 


• 4301 


.4675 


. 3930 


• 2568 


.5752 


.4855 


• 4hb 3 


.5965 


.58 30 




6. R-107 63 Phys. Sci. 


.4706 


.5301 


.5657 


.3532 


.4635 


. 3291 


.2825 


.5046 


.424^ 


.40 66 


• 5 5 0 / 


.02 39 




7. R-108 63 Bio. Sci. 


.4347 


• 4655 


.500 7 


• 3035 


• 3829 


.2924 


• 22b6 


• 4288 


. if)94 


. 35 04 


. 4 6 3 


.562 3 




8. R-109 63 Scient.Att 


.3769 


• 4599 


.4 738 


.2576 


. 3532 


• 2439 


.1885 


• 3843 


.3576 


• 196 2 


.4445 


.5 7 19 




9. R-110 63 Aero-Space 


.3846 


.4366 


.4297 


.2272 


• 2849 


• 1175 


• 1 4 5 6 


.2252 


• 264 3 


.2011 


. 1 6 1 6 


• 46/1 




10. R-111 63 Electronic 


.3386 


• 2889 


.3153 


• 2304 


.3215 


.2071 


• 1600 


• 2826 


• 2/56 


.2551 


.3017 


.41 35 


ii 


U. R-112 63 Mechanica 


.3850 


. 3873 


.4265 


.2035 


.2 763 


. 1654 


. 1 702 


• 2860 


.2 382 


.2 7*>2 


. 3441 


.4635 


1 


12. R-U3 63 Farming 


.3912 


.4164 


.5099 


• 2633 


.2924 


• 2818 


.2868 


• 4191 


.4026 


. 1826 


.4284 


• 55/6 




13. R-114 63 Home Ec. 


.3903 


. 3865 


.4703 


.1815 


• 1809 


• 1B?1 


• 1914 


.2 797 


.253/ 


. 1220 


. 106 1 


.4316 


d 

0 


14. R-115 63 Sports 


.4240 


.4979 


.4401 


.3316 


.3707 


• 301,4 


• 2488 


• 4227 


• 3401 


. 3352 


.402 8 


.4365 


•H 

ii 


15. R-13X 63 Art 


.4700 


.6300 


.5960 


.4142 


.4210 


. 3935 


.3041 


• 4100 


.3912 


.4007 


.4 103 


.659 1 


6 


16. R-132 63 Law 


.4093 


.5221 


.5468 


.4019 


.2739 


.3637 


. 3073 


• 4333 


. 363 / 


. 1489 


.4/86 


.5921 


N 

0 


17. R-133 63 Health 


.3930 


.4934 


.5521 


.3424 


.3056 


. 3521 


. 3591 


• 4017 


.4423 


.3165 


.4147 


.53 3? 


d 


IB. R-X34 63 Engin. 


.3569 


.3678 


.3541 


.2006 


• 1289 


.2075 


• 1588 


.2404 


.2222 


.21 )2 


.2878 


. 372 / 


m 


19. R-135 63 Arch. 


.3127 


.4058 


.3650 


.3312 


.2610 


^3207 


.21 /4 


• 3441 


. 32 39 


.2092 


.1538 


.4540 




20. R-138 63 Militjary 


.2904 


.3878 


.3683 


• 3276 


.2139 


.2877 


.2539 


. 3327 


. 3020 


‘ . 1051 


. 3278 


• 195 / 




21. R-139 63 AcctfBusi. 


• 3B9L 


• 5189 


.6174 


.3179 


.3102 


. 3228 


.2527 


• 4467 


.3314 


. 1738 


.4334 


.5477 




22. R-140 63 Prac.Knowl 


.34 86 


.4132 


.3897 


.2674 


• 2018 


.2782 


.2487 


• 3205 


.2500 


.2386 


. 346 3 


.434 1 




23. R-142 63 Bible 


.3310 


.4118 


• 4343 


.4105 


.2805 


.3006 


.2537 


. 3662 


. 3902 


. 3490 


.4421 


.5094 




24. R-145 63 Hunting 


.0816 


.0555 


.0699 


.0680 


.0263 


.0413 


• .0462 


.0178 


-.02/8 


.0 309 


.0324 


.00 52 




25. R-146 63 Fishing 


.1165 


.0^59 


.0680 


• 0845 


.0024 


. 1189 


-.0193 


.0961 


.0928 


.0182 


-.0141 


.0601 




26. R-147 63 Outdoor 




• 4456 


.5215 


• 3260 


.2270 


. 3215 


• 263!> 


.401 1 


. 323/ 


. 3319 


. 17t 1 


.5262 




27. R-150 63 Theater 


.44 56 




.5830 


• 4171 


.3470 


. 3722 


.2047 


.4318 


.3711 


.4050 


.4155 


.5625 




28. R-162 63 Vocab. II 


.5215 


.5830 




.3954 


.3497 


. 3747 


.2952 


.4254 


.4476 


. 3565 


.4/92 


.6241 




29. R-212 63 Mem. Words 


.3260 


.4171 


.3954 




.3676 


.39 14 


.2690 


.4802 


.4230 


. 3624 


.4809 


.5187 


u 


30. R-220 63 Disg. Wds. 


.2270 


.3470 


.3497 


.3676 




.5222 


. 3565 


.5640 


.4865 


.4 39*/ 


.4/0/ 


.5094 


•} 


31. R-231 63 Spelling 


.3215 


.3722 


.3747 


.3914 


• 5222 




.4326 


.5797 


.3176 


.4Cbl 


.494 9 


.4870 


H 


32. R-232 63 Capital. 


.2635 


.2847 


.2952 


.2690 


.3565 


.4326 




.5039 


.4 960 


.4159 


.2495 


. 3295 


Xi 

» 


33. R-233 63 Punct. 


.40 1 1 


.4318 


.4254 


.4802 


• 5640 


.5797 


.50 39 




.6265 


.556? 


.61/3 


.6356 


•H 

H 


34. R-234 .6,3 Eng. Usage 


. 3237 


.3711 


• 44 76 


.4230 


.4865 


.5176 


.4960 


.6265 




.5291 


.4104 


.59 76 




35. R-235 63 Eff. Exp. 


• 3319 


.4050 


.3565 


. 3624 


.4399 


.4051 


.4150 


.5567 


.5291 




.4312 


.5081 


H 


^ .R-240 63 Word.Funct 


. 3703 


• 4155 


.4792 


.4809 


.4707 


.4949 


.2495 


.6173 


.4184 


.4 112 




.0635 




37. R-250 63 Rdg. Compr 


.5262 


.5625 


.6241 


.5187 


.5094 


, .4870 


.3295 


.6356 


.4976 


.5061 


.6635 






36. R-260 63 Creativity 


.3079 


• 3529 


.4509 


.3631 


.4658 


. 3647 


.29)3 


.5212 


.418/ 


.4421 


.5154 


.5905 




39. R-270 63 Mech.Reas 


.3978 


.,2966 


.3224 


.3204 


.3725 


. 3064 


• 2673 


. 5098 


.3988 


.36 99 


.45// 


.58 7? 




^d. R-2B1 63 Vis. 2 Dim 


.2338 


.1182 


.1724 


.1853 


• 3040 


• 1405 


.2099 


• 3234 


. 2305 


.2/54 


.2/90 


.2934 




41. R-282 63 Vis. 3 Dim 


.3309 


.1783 


.3063 


.3129 


.3192 


• 2236 


.2046 


.4094 


.3000 


. 3056 


.444 2 


.4558 




42. R-290 63 Abst.Reas 


.4037 


.4053 


.4565 


.4081 


.3565 


.3425 


.3312 


.5466 


.4014 


.4589 


.50/2 


.5233 


.d U 


W. R-311 63 Arlth.Reaa 


.3896 


.4710 


.5302 


.4430 


.4404 


• 4265 


.3260 


• 6071 


.4695 


.4783 


.5/53 


.6 193 


u m 


44. R-3/12 63 Int.HSMath 


.4373 


• 4188 


.4436 


,4232 


.4441 


.4 170 


.3084 


. 5795 


.4828 


.4242 


.6047 


.5710 


jfiH 


45. R-333 63 Adv.HSMath 


.3795 


.3491 


.3135 


.3217 


.3336 


.2645 


.1971 


.4079 


. 3500 


. 2 723 


.4451 


. 3973 




4^, F-410 63 Arith.Comp 


.2439 


.2642 


.2573 


. 3374 


.3354 


. 3763 


.2909 


.4487 


. 322 / 


.3444 


.33/0 


.3 74 7 




47. F-420 63 Xablt i(ead 


.1201 


.2325 


.1976 


.2773 


.3066 


.2446 


.1986 


.2401 


.2098 


.2116 


.2380 


.2306 




48. F-430 63 Cler. Check 


.1063 


. 1163 


.1725 


.2056 


.3907 


• 3566 


.2433 


.341 L 


.2425 


. 3025 


.2496 


.2243 




49. F-440 63 Obj.Inap. 


. 1413 


.1506 


. L30L 


.2392 


.2905 


. 1914 


• 2062 


.2259 


.1592 


.252 1 


.2660 


.2422 




50* R-102 60 Vocab. i 


.4796 


.5034 


.5983 


.4356 


.5294 


.4523 


.2808 


.5307 


.45 /2 


.4 365 


.5412 


.6514 




51. R-103 60 Literaturt 


.4 101 


.54*8 7 


• 5156 


.3787 


• 4466 


.3925 


.2751 


.4609 


.41 ro 


.4062 


.4520 


.5751 




52. R-104 60 Music 


.4233 


.5410 


.5225 


.3965 


.4560 


. 3857 


.2620 


• 4636 


.4041 


.3780 


.461/ 


.53/2 




53. R-105 60 Soc. Stud. 


• 42 70 


.5507 


.59 37 


.4415 


• 4413 


.4310 


.3015 


.5497 


.4511 


.4229 


.5475 


,.64/9 




54. R-106 60 Math 


• 3966 


.4605 


.4733 


.4035 


• 3646 


. 3509 


• 2314 


.4777 


. 3897 


. 1720 


.5247 


.4975 




55. R-107 60 Phys. Sci. 


.3958 


.4741 


.4009 


.3456 


.4371 


. 3534 


.2492 


.4400 


. 38H5 


. 3506 


.5265 


.5758 




56. R-lOB 60 Bio. Sci. 


.3762 


.4033 


.4563 


.3436 


.3543 


.3163 


.2104 


.4030 


.3548 


. 3422 


.444/ 


.5042 




57. R-109 60 Scient.Att 


.3376 


.3840 


.4463 


.3013 


i33L5 


.2551 


.1901 


• 3996 


. 3309 


. 3583 


. 39 35 


.4994 




5B. R-110 60 Aero-Space 


.2905 


.32 02 


.3117 


.2346 


• 2164 


.1692 


. 1274 


.2150 


.2167 


.1916 


.2594 


.3291 




59. R-111 60 Electronic 


.2462 


.2437 


.2608 


. 1924 


• 2124 


.2064 


• 1283 


.2429 


.2223 


.2021 


.2352 • 


.2717 


4i 

II 


60.^ R-112 60 Mechanica 


.3207 


.3182 


.356 7 


.2467 


.2719 


.2036 


.1476 


.2802 


.2510 


.24 38 


. 306 7 


. 3998 




61. R-il3 60 Farming 


. 36 1 7 


• 4243 


.4041 


• 3440 


.3266 


.3211 


.259^ 


• 4220 


. 3 781 


.3/41 


.4285 


.5388 


'd 


62. R-114 60 Home Ec. 


. 3799 


• 3640 


.4329 


.3122 


.3094 


.2774 


.2i;^ 


. 3766 


.31 78 


.32/9 


. ,3985 


.44 90 


0 

•H 


63. R-115 60 Sports 


.3400 


.4247 


.3951 


.3162 


.2793 


.2749 


.19.26 


.3534 


*,2936 


. 3021 


. 156 1 


.4144 


4i 

!• 


64. R-131 60 Art 


• 4212 


.5334 


; .5308 


.3602 


.4277 


. 3719 


.228 3 


.4381 


.3846 


. 369? 


.4422 


.5790 


.e 


65. R-132 60 Law 


.3103 


.3717 


.4135 


.2966 


.2697 


• 2503 


.1870 


.3414 


.2972 


.2559 


.306 3 


.4382 


& 


66. R-133 60 Health 


.3661 


.4646 


• 5165 


.3431 


.3724 


. 3836 


.2626 


.4358 


. 3983 


.3713 


.4199 


.5215 


..s 


67. R-134 60 Engin. 


.3251 


.3000 


• 3439 


.2423 


• 2620 


.2574 


. 1396 


.2909 


.2135 


.2158 


.3 12 7 


.3817 




66. R-135 60 Arch, 


• 2546 


• 2070 


• 2805 


• 2599 


• 2356 


.2537 


. 166 r 


.2764 


.23/9 


.22/8 


.2862 


.314/ 




69. R-13B 60 Military 


.2349 


.2753 


.2739 


.1963 


• 1373 


• 1466 


.0831 


• 1932 


.16/4 


.1544 


• 1751 


.2545 




70. R-139 60 Acct.Buai. 


.3322 


.4200 


.4579 


. .2761 


4 33 17 


• 3091 


.2055 


. 3708 


.3117 


.2950 


.417/ 


.4831 




71. R-140 60 Prac.Knowl 


• 3145 


. 3735 


•M46 


■ .2430 


.2921 


. *2443 


.2043 


.3307 


.2449 


.29/7 


• 3288 


.4256 




72. R-142 60 Bible 


• 3104 


.3752 


• 3984 


• )792 


.3052 


.2939 


. 1829 


• 3925 


.3299 


.2999 


.4122 


.5455 




73. R-145 60 Hunting 


• 0611 


• 0652 


.0929 


• 0313 


.0270 


.0232 


.0407 


• 0404 


.0401 


.0205 


.0226 


.05 78 




74. R-146 60 Fishing 


.0409 


.0785 


.0075 


.0365 


-.0203 


.0384 


-.0150 


.0155 


.0154 


.016? 


.0403 


.0358 




75. R-147 60 Outdoor 


.5121 


• 4089 


.4373 


. 3331 


.3554 


• 2965 


.2255 


.3859 


.3210 


. 3644 


. 3860 


.4642 




76. R-150 CO Theater 


• 4038 


.6321 


.4928 


. 3730 


• 4125 


. 3836 


.2348 


• 4015 


. 3856 


. 3607 


.4171 


.51 /8 




77. R-162 60 Vocab. II 


.4418 


.5399 


.6196 


.4103 


.4642 


.3995 


.2635 


.4864 


.4215 


. 3HH3 


.5062 


.6160 




78. R-212 60 Mem. Words 


.2610 


.3166 


.3618 


.5533 


.3455 


. 3265 


• 1935 


• 3836 


. 3364 


.3104 


.4141 


.4285 


4i 

'M 


79, R-220 60 Disg. Wds. 


.3377 


• 4460 


.4453 


.3 777 


.6099 


.4505 


.2432 


• 4664 


.4408 


.34/4 


.4754 


.4951 




"BUT R-231 60 Spelling 


.2425 


• 3402 


.3023 


.3564 


.4439 


*5652 


.2294 


• 4662 


.3597 


.‘3002 


.4/66 


.4200 


jd 


Bl. R-232 60 Capital. 


.3556 


.4160 


.44 78 


.2720 


.2870 


. 3342 


.3087 


.4104 


.3193 


. 32 36 


. 3 375 


.3689 


n 

iH 


B2. R-233 60 Punct. 


• 3928 


.4550 


.5066 


.4440 


.4606 


• 4966 


.3399 


• 6927 


.5211 


.4509 


.6244 


.5809 


H 


83. R-234 60 Eng. Usage 


.3488 


.4047 


.4295 


.3161 


• 4046 


• 3631 


.2634 


.4752 


.4924 


. 302? 


.4396 


.49 39 


£ 


B4. R-235 60 Eff. Exp. 


.2881 


. 3019 


• 4153 


.3206 


.3362 


. 3394 


• 2498 


• 4242 


.3868 


.4005 


.4064 


.4820 


85. R-240 60 Word.Funct 


.3775 


• 4194 


• 4314 


.4523 


.4531 


.4290 


.2510 


.5670 


.4513 


.4092 


. 6606 


.5328 




86. R-250 60 Rdg. Compr 


.4550 


.5734 


.5973 


• 4738 


• 4978 


• 4619 


• 3396 


• 6018 


.5178 


.5005 


.608 / 


. 7643 




87. R-260 60 Creativity 


• 3518 


• 4140 


«4095 


. 3274 


.3363 


• 2800 


.2111 


.4047 


. 3389 


. 3500 


.4320 


.4889 




B8. R-270 60 Mech.Reas 


.3728 


• 3330 


. 3797 


• 3012 


.3194 


.2367 


• 1935 


• 4155 


.3511 


. 3306 


.394 9 


.4195 




B9. R-281 60 Vis. 2 Dim 


• 2723 


.2465 * 


• 26 11 


• 2356 


.2886 


.1739 


• 1877 


.3210 


.2496 


.201 1 


. 1132 


. 3023 




90. R-282 60 Vis. 3 Dim 


• 2610 


• 2568 


• 2938 


• 2594 


.2703 


• 1820 


• 1931 


.3517 


.2465 


.2793 


.3713 


.1732 




91. R-290 60 Abst.Reas 


.3320 


• 3780 


• 4335 


• 3781 


.3820 


• 2980 


• 24 12 


• 4963 


. 3827 


.4073 


.4989 


.4896 




9?. R-311 60 Arith.Reas 


.3709 


• 4217 


.5055 


• 4063 


• 4129 


• 3890 


.2563 


• 5369 


.4208 


.4208 


• 564 1 


.5821 


Ti « 


93. R-312 60 Int.HSMath 


• 3BB6 


.4657 


.4717 


• 4124 


.4080 


.4017 


• 2366 


• 5385 


.4221 


. 3944 


.594 7 


.5443 


* H 


94. R-333 60 Adv.HSMath 


• 1289 


• 0090 


.0714 


• 0667 


.0637 


• 0665 


.0457 


• 0841 


• 0498 


.0653 


.0/54 


.08 30 


95. F-410 60 Arith.Comp 


• 2011 


• 2493 


• 2644 


.2998 


.3274 


. 3787 


.2736 


.4392 


• 344 2 


. 3632 


• 4168 


.4114 




96. F-420 60 Table 


• 1516 


.1708 


• 1460 


.1274 


. 1950 


• 1666 


.2267 


.2559 


.1609 


.1610 


.1978 


.1835 




97. F-430 60 Cler. Check 


• 1092 


• 1455 


• 1223 


• 2050 


• 3184 


• 2840 


• ?145 


.2775 


.2278 


.160/ 


• 25M9 


.2205 




9B. F-440 60 Obj.Inap. 


• 1451 


• 1162 


.0974 


• 1453 


• 2099 


• 1363 


.1551 


• 2128 


• 1415 


.14 35 


.1093 


.1838 


99. P*B01 60 Socioecon. 


• 3962 


.3 709 


.3345 


.2521 


• 3066 


• 1861 


• 1741 


.2637 


.2454 


.27/7 


.2894 


. 3406 



1 

[ 




ij 



I 



F 

I 

j 



1 
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TABLE 6-i^> (continued) 



3H 


39 


40 


41 


42 


43 


.^742 


.5161 


.2982 


.4605 


.504 7 


.6249 




.42 34 


.241 3 


. 3765 


.4495 


.54 /9 


.434;? 


.42^6 


.2346 


' . 3597 


• 4196 


• 4866 




.42 00 


• 2476 


• )602 


• 4564 


• 5838 




.5 3 39 


. 3 309 


• 4483 


.4699 


• 6514 


.bli 7 


.5459 


• 3109 


.4536 


.469/ 


.5882 


.4978 


.4791 


.2858 


.4099 


. 367 1 


.4625 


.4434 


.3809 


.2162 


.3/05 


• 4 2 2 6 


• 4620 


.4308 


.4694 


.2584 


. 3845 


• 3160 


• 2940 


.4030 


.415/ 


.2505 


.3600 . 


.2876 


• 3810 


.4^2^ 


• 4 3 3 1 


.2428 


• 4073 


. 3387 


• 3802 


.4 360 


. 3962 


.2602 


• 3494 


.3713 


• 4864 


.344^ 


.3124 


• 1901 


. 3487 


. 3545 


. 3880 


.43?8 


. 3 392 


• 2413 


.2729 


. 3733 


• 4543 


. 4S 1 4 


.361 / 


• 1824 


• 2994 


• 4419 


.4597 


• 4010 


• 3103 


• 1 109 


.2742 


• 4028 


• 406 / 


. 3401 


.2402 


• 164 1 


.2973 


. 3730 


• 409/ 


.^397 


.23/5 


.1959 


.2557 


.2972 


.30’6‘i 


.^970 


• 1994 


.0952 


• 2390 


• 2932 


.366 7 


. 3467 


• 3138 


• 1 368 


.23 77 


.2555 


.31 70 


.4087 


. 3252 


• 1 851 


• 28/2 


.4217 


.5506 


.^69 3 


.21 38 


.1085 


• 2171 


. 5235 


.295 7 


. 3494 


.2695 


• 1661 


• 3419 


• 3415 


.4309 


.0618 


.0/59 


• 0164 


• 0313 


.0600 


.0398 


. 1/9^ 


.0559 


.0692 


.0499 


• OH 76 


• 0821 


. 30 79 


. 3978 


.2 336 


. 3 309 


.4037 


.3896 


.34?9 


.2966 


• 1 182 


. 1763 


.4053 


.4710 


.4 ‘■>09 


• 3224 


.1/24 


• 3063 


.4565 


.5302 


. 36 31 


.3204 


.1853 


.3129 


• 4081 


• 44 38 


.46S8 


.3725 


. 3040 


• 3192 


. 3565 


• 4404 


.364 7 


.3064 


.1^05 


.2236 


. 3425 


• 4265 


.<*993 


.26/3 


.2 099 


.2046 


• 3312 


. 3260 




.5098 


. 3234 


• 4094 


.5466 


• 6071 


• 418 7 


.3988 


.2305 


.3000 


• 4014 


.4695 


.4429 


. 3699 


.2 754 


• 3056 


.4589 


• 4783 


.‘ilS4 


.45 7/ 


.2 790 


.4442 


.5072 


.5/53 


• 69(r> 


.4892 


• 2934 


.4558 


.52 33 


.6193 




.4939 


• 3 3 1 6 


• 4564 


• 4671 


• 5185 


.4939 




• 4617 


• 5668 


.5074 


.4795 


• 3316 


.4617 




.4593 


. 3756 


.2912 


• 4564 


.5668 


.4593 




• 5060 


• 4568 


.4671 


.50 74 


. 3 756 


.5060 




.5766 


.5185 


.4795 


• 2912 


• 4568 


. 5766 




.4651 


.47 75 


• 2464 


• 4081 


.5038 


• 6466 


.3562 


• 3 888 


• 20/4 


• 3414 


• 3368 


.4 75 3 


.2671 


.2258 


• 2326 


.2377 


• 3940 


• 4065 


.2399 


.21 /5 


• 2534 


• 2492 


• 2449 


• 2319 


• 2400 


• 2161 


.2525 


• 21 71 


• 2236 


• 2624 


• 2484 


. 3065 


. 3360 


.3469 


.2932 


.2157 


.5357 


• 4496 


.2597 


• 3 784 


• 4389 


.5778 


• 43/4 


.3584 


• 2214 


.3177 


• 3768 


• 4674 


• 4345 


.3722 


.2251 


.3136 


• 3822 


.4791 


.4721 


.4085 


• 221 1 


• 3646 


• 4501 


.5693 


.4369 


• 40/3 


.2607 


• 3643 


• 4185 


.5521 


• 4433 


.4547 


.2693 


. 3669 


• 4150 


• 508 3 


• 4104 


.3603 


. 1970 


• 3206 


• 3333 


• 4411 


.3652 


.3023 


. 1986 


. 30 39 


• 3686 


• 4540 


.2909 


. 332 7 


• 171/ 


• 2424 


.2361 


.2829 


.2755 


• 2380 


• 1631 


• 1807 


.2158 


• 2936 


. 3928 


.4002 


.2275 


• 3410 


.2857 


• 3/15 


.4175 


.3716 


.2275 


.3^68 


. 3747 


• 4905 


• 4212 


.3565 


• 2441 


• 3648 


• 3638 


• 434 / 


.3558 


• 3044 


• 2 139 


.2539 


• 3243 


• 4030 


• 4694 


• 3850 


• 2389 


. 3332 


• 4044 


• 4394 


.3594 


.2566 


• 1451 


• 2324 


• 2844 


.3915 


• 3878 


• 2863 


• 1931 


• 2644 


• 3637 


• 4309 


.3252 


• 3038 


.2017 


• 2628 


• 2838 


• 3066 


.2755 


.2286 


• 1540 


• 2241 


• 2306 


• 2823 


. 1.990 


• 1 746 


• 0962 


.1279 


• 1 720 


• 2143 


.4002 


.29/8 


• 1912 


• 2690 


• 31 74 


.4329 


.3409 


.2//1 


• 1971 


• 2589 


• 3183 


• 3138 


.3 720 


.2762 


• 1 703 


• 2921 


• 3135 


.41 77 


.0586 


.03 70 


-.0119 


.0416 


.0506 


.0703 


.0712 


.0326 


• 0320 


.0161 


.0227 


• 02 14 


• 3858 


.3402 


.2 377 


.3255 


• 3658 


• 4368 


• 4169 


• 3124 


• 1 803 


• 2645 


. 3475 


• 4183 


• 4812 


.,3598 


.2233 


.3372 


• 4085 


• 5017 


.3596 


• 31 38 


• 2042 


.2917 


• 3242 


• 3824 


• 4286 


.3555 


• 24 74 


• 3026 


• 3822 


• 4051 


.3659 


.2456 


• 1 546 


• 2284 


• 302 8 


• 3826 


• 2838 


• 2493 


• 1803 


• 2087 


• 3543 


• 3683 


• 4480 


.4250 


• 2650 


• 3933 


• 4817 


• 5888 


• 3526 


• 3125 


.2005 


.2830 


.3517 


• 4195 


. 3335 


.3047 


• 1814 


.2395 


• 3629 


• 4121 


.4535 


• 4005 


• 2486 


• 3489 


• 4336 


.5693 


• 5346 


• 4430 


.2 725 


• 4008 


• 5033 


.6236 


.5391 


.3840 


• 2461 


.3629 


• 4064 


• 4678 


• 4186 


• 6350 


• 3802 


• 4895 


.4599 


• 4918 


.2952 


• 4080 


.5653 


• 4143 


• 4008 


• 3469 


.3829 


• 4912 


• 4213 


.5855 


• 4644 


• 4046 


.4455 


• 4782 


• 3666 


• 4751 


• 6004 


• 5243 


.4 7 76 


• 4602 


• 2938 


• 4422 


• 4941 


.6837 


.4611 


• 4608 


• 2861 


• 4280 


• 4816 


• 6031 


.1042 


.1052 


• 0423 


.0707 


• 0796 


.0958 


. .3096 


• 2621 


.2325 


.2719 


. 3395 


• 3858 


. 162/ 


• 1615 


• 1429 


• 1445 


.2221 


• 1669 


.1919 


• 1406 


.1559 


• 1708 


• 1945 


.2272 


, 1886 


.2287 


.2280 


.2699 


• 2691 


. 1923 


,2910 


.2901 


• 1456 


• 2164 


.3105 


. 3300 



44 


4b 


46 


4 / 


48 


.5539 


. 3 764 


. 39 39 


.2816 


.2568 


. 5754 


• 4 116 


.299? 


. 1928 


.1887 


.5075 


. 3561 


. 32b9 


. 1 882 


. \ 292 


• 5886 


.3911 


. 347t> 


.2145 


• 2 110 


• 8330 


• 6756 


. 38 35 


.2 392 


.2625 


• 6332 


.5020 


.3218 


.2637 


.2350 


.4751 


• 3105 


.2126 


. 1632 


. 1 549 


.4039 


.2491 


.27/9 


. 22 72 


• 1 362 


• 3180 


.2728 


. 1 34H 


. 1866 


.1635 


• 4403 


. 3266 


.2 /03 


• 1862 


. 1949 


• 3247 


.2121 


.2551 


o 1 76/ 


• 1 2 96 


• 3826 


.2256 


. 3225 


• 1614 


. 1 339 


• 3153 


.1562 


.240 / 


.07/9 


• 0140 


.4316 


• 3333 


1.2923 


.2070 


• t 7 1 5 


• 4262 


.3/47 


• 2 /Hd 


. 2335 


• 0786 


• 4209 


• 3444 


• 2806 


• 1238 


.1297 


. 3997 


• 30 13 


.2709 


.3287 


.1517 


• 2493 


.2 374 


• 130H 


• 1125 


.0835 


.3786 


• 3603 


.1947 


• 1221 


• 1 009 


• 3544 


.3101 


.2223 


.1001 


• 1 103 


• 4330 


.292? 


. 35H1 


• 2014 


• 1461 


.2938 


.2234 


.3003 


.2185 


.0802 


• 3803 


.2891 


.2836 


• 184 8 


• 0419 


.0268 


-.002 / 


.0574 


.0335 


• 0634 


.0756 


.0939 


.0756 


.0522 


• 0876 


• 4373 


.3/95 


.24 39 


.1201 


• 1063 


• 4168 


. 3491 


.2642 


.2325 


• 1163 


• 4436 


.3135 


.257 3 


• 1976 


. 1 725 


.4232 


• 321 7 


. 3374 


.2 7 7 3 


.2056 


• 4441 


. 3336 


.3354 


. 3068 


. 3907 


• 4170 


.2645 


.376.3 


.2448 


• 3568 


• 3084 


.1971 


.2909 


• 1986 


• 2433 


.5795 


.4079 


.448/ 


• 2401 


• 3411 


• 4828 


. 3500 


. 322 7 


.2098 


.2425 


• 4242 


. 2723 


• 3444 


.21 16 


.3025 


• 604 / 


.4451 


. 33 78 


. 2380 


.2496 


.5710 


.3973 


. 3747 


. 2306 


.2243 


• 4651 


. 3562 


• 26 / 1 


. 2399 


.2400 


.4775 


• 3688 


.2258 


.2175 


.2161 


.2464 


.2074 


.2326 


. 2534 


.2525 


• 4081 


• 3414 


.23/7 


.2492 


.2171 


• 5038 


. 3366 


• 3940 


• 2449 


.22 36 


• 6466 


.4753 


.4065 


.2319 


• 2624 




.6583 


• 4162 


.2.330 


.2767 


.6583 




.2323 


. 1659 


.2225 


• 4162 


.2323 




.4152 


.4114 


.2330 


. 1659 


.4152 




• 3768 


.2767 


.2225 


.4114 


. 3768 




• 1445 


.1079 


.2857 


.4493 


.3708 


. 5445 


• 4201 


.3115 


. 1920 


.2302 


.4926 


. 3952 


.2526 


.1/73 


. 1999 


.4019 


• 3691 


.2896 


.1630 


.2002 


. 5727 


• 4334 


• 3066 


. 1 757 


.22 38 


• 6176 


.5254 


• 28 38 


.2043 


.2265 


.4903 


• 4000 


• 2266 


.1837 


a2335 


• 4454 


• 3647 


.2117 


.0940 


.1208 


.3921 


.2 792 


.2150 


.0967 


.1393 


• 2868 


• 2408 


. 1059 


. 1244 


.1094 


.2814 


.2233 


.1511 


.1015 


.12 71 


.3175 


• 2652 


. 1 781 


.1058 


.1171 


• 4142 


• 2919 


.2637 


• 1008 


.1345 


• 3768 


• 2781 


• 2803 


. 1428 


• 1205 


• 4068 


• 3128 


• 2662 


.2033 


.2068 


• 4323 


• 3427 


• 26 31 


• 1441 


.1024 


• 3743 


.2955 


.2065 


• 1066 


• 1 192 


.3904 


• 2693 


.2991 


• 1622 


.1748 


• 2894 


.2031 


• 1976 


.1213 


.1333 


. 2774 


• 2419 


.2111 


• 1041 


• 1419 


• 2286 


• 1856 


.1169 


• 0658 


• 0566 


• 3875 


.3011 


.2427 


. 14/4 


• 1835 


. 3077 


.2099 


.2500 


• 2138 


.1727 


• 4143 


• 2954 


.2438 


• 0904 


.0765 


• 0410 


-.0208 


.0751 


• 0334 


.0176 


.0164 


.0157 


• 0147 


-.0098 


-.0034 


• 4042 


• 3208 


.2/33 


.2164 


• 1 716 


• 3912 


• 3100 


• 2430 


• 1660 


• 1806 


.4555 


. 34 74 


• 2843 


. 1621 


• 1827 


• 3857 


.2899 


• 2606 


• 1 306 


• 1 781 


• 3981 


.2928 


• 2846 


• 2447 


• 2870 


• 4060 


.2766 


• 3283 


• 1982 


.2572 


• 3510 


• 2091 


.2938 


• 1679 


• 1531 


• 5940 


• 4262 


. 3974 


• 1950 


• 2182 


• 3847 


• 2666 


.2967 


.1457 


• 1630 


• 3655 


.2551 


.2777 


.0970 


• 1178 


• 5853 


.4699 


. 3369 


• 1600 


• 2360 


.5751 


• 4245 


. 3555 


• 2021 


• 2414 


• 4150 


. 3377 


• 2466 


• 134/ 


.1743 


• 4476 


• 3699 


.22 78 


• 1749 


• 1674 


.3207 


• 2261 


.2554 


.2005 


.2002 


• 3934 


• 3186 


.2104 


. 1592 


• 1599 


• 4677 


. 3471 


. 3126 


.2224 


.2396 


.5 769 


• 4435 


. 35B8 


• 1341 


• 2145 


• 6751 


.5242 


.3650 


.2 38 1 


.2229 


. 1272 


• 1496 


• 0646 


• 0486 


• 0445 


• 3626 


.2329 


.4828 


.2453 


• 2311 


. 1749 


.0805 


. 23 35 


.2295 


• 1612 


.2637 


.1620 


.2746 


. 2066 


• 2830 


• 1881 


.1134 


.221 1 


.2465 


.2350 


• 3691 


.2867 


.1450 


.1085 


.205C: 



49 


50 


. 3061 


.7‘>6 ) 


.2127 


• 66 /4 


.2240 


.6329 


.2081 


.6516 


.2516 


• 6034 


.27)6 


.6594 


.24 U 


.57/9 


.2010 


.4918 


.2395 


.4655 


.2545 


.4616 


.2854 


.4570 


.2152 


.SIC / 


• 1164 


.4106 


.2103 


.5099 


.1715 


• 6012 


.0912 


.5374 


.2200 


.5155 


.1999 


.3652 


.0875 


• 48C2 


• 1085 


.4426 


• 1276 


• 5313 


• 1 700 


. 3/iC 


.0702 


• 4683 


• 0104 


.0720 


• 0306 


.07/1 


• 141 3 


.4 798 


.1506 


.5834 


• 1301 


.5983 


.2392 


• 4356 


.2905 


.5294 


• 1914 


.4523 


• 2062 


• 2808 


.2259 


.5307 


.1592 


.4572 


.2523 


.4365 


• 2660 


.54 12 


.2422 


• 65 1 4 


• 2484 


.5357 


• 3065 


• 4496 


• 3360 


.2597 


.3489 


• 3784 


.2932 


• 4389 


.2157 


.5 778 


• 1445 


• 5445 


.1079 


• 4201 


.2857 


• 3115 


• 4493 


• 1920 


. 3708 


• 2302 




.2191 


.2191 


• 


. 1 745 


• 6494 


.2056 


• 62 15 


. 1595 


• 6883 


.1799 


• 5820 


• 2063 


• 614 1 


• 1309 


• 5623 


• 1110 


• 4822 


.1283 


.4037 


.0661 


• 3683 


.1629 


• 4746 


.1583 


• 5351 


.1695 


• 4981 


• 2181 


• 4871 


.1602 


.6191 


• 0847 


• 4586 


• 1694 


• 5634 


• 1484 


• 4157 


• 1487 


• 3908 


• 0616 


• 3146 


• 1294 


.5269 


• 1 782 


.4157 


• 0891 


• 4831 


.0343 


• 0823 


• 0065 


• 0530 


• 2036 


• 5042 


• 1689 


.5902 


• 1765 


• 6350 


• 1406 


.4173 


• 2374 


.5372 


• 1290 


• 4637 


. 1573 


.3473 


.1959 


.5572 


• 1 729 


• 4686 


• 1108 


• 4117 


• 2039 


• 5445 


• 2010 


.7135 


. 1770 


.5201 


.2327 


.4639 


.2723 


.3050 


.2437 


. 1489 


• 3051 


.4637 


.1935 


.5647 


.227 / 


.5528 


.0310 


.1107 


• 2148 


.3393 


• 1694 


• 1810 


.2002 


.2226 


.4068 


• 18C6 


.1571 


.412*^ 



RIC 



Varlablfc 

1. R-102 63 

2. R-103 63 

3. R-104 63 

4. R-105 63 

5. R-106 63 

6. R-107 63 

7. R-108 63 

8. R-109 63 

9. R-110 63 

10. R-Ul 63 

11. R-112 63 

12. R-113 63 

13. R-114 63 

14. R-115 63 

15. R-131 63 

16. R-132 63 

17. R-133 63 

18. R-134 63 

19. R-135 63 

20. R-138 63 

21. R-139 63 

22. R-140 63 

23. R-142 63 

24. R-145 63 

25. r-146 63 

26. R-147 63 

27. R-150 63 

28. R-162 63 

29. R-212 63 

30. R-220 63 

31. R-231 63 

32. R-232 63 

33. R-233 63 

34. R-234 63 

35. R-235 63 

36. R-240 63 

37. R-250 63 
36. R-260 63 

39. R-270 63 

40. R-281 63 

41. R-282 63 

42. R-290 63 

43. R-311 63 

44. R-312 63 

45. r- 333 63 
4b. F-410 63 

47. F-420 63 

48. F-430 6 3 

49. F-440 63 

50. R-102 60 

51. R-103 60 

52. R-104 60 

53. R-105 60 

54. R-106 60 

55. R-107 60 

56. r-108 60 

57. R-109 60 

58. R-110 60 

59. R-111 60 

60. R-112 60 

61. R-113 60 

62. R-114 60 

63. R-115 60 

64. R-131 60 

65. R-132 60 

66. R-133 60 

67. R-134 60 

68. R-135 60 

69. R-138 60 

70. R-139 60 

71. R-140 60 

72. R-142 60 

73. R-145 60 

74. R-146 60 

77. R-162 60 

78. R-212 60 

79. R-220 60 

80. R-^31 60 

81. R-232 60 

82. R-233 60 

83. R-234 60 

84. R-235 60 

85. R-240 60 

86. r-250 60 

87. R-260 60 

88. R-270 60 

89. r-281 60 

90. R-282 60 

91. R-290 60 

92. R-311 60 

93. R-312 60 

94. R-333 60 

95. F-410 60 

96. F-420 60 

97. F-430 60 

98. F-440 60 

99. P*801 60 
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TABLE 6«lb (continued) 



. i 





Variable 


51 


52 


53 


54 




“ R-102 63 Vocaba I 


• 6156 


• 6062 


• 6919 


.5758 




2a H-103 63 Licerature 


.7143 


.5902 


.6851 


.5646 




3. R-104 63 Music 


.5 726 


• 7367 


• 6116 


.5004 




4a R-IOS 63 SOCa Studa 


• 5979 


.5629 


• 7924 


.5445 




5a R-106 63 Math 


.5452 


.5253 


• 6162 


•6840 




6a R-107 63 Physa Scia 


• 5655 


.5515 


• 6645 


.5917 




7a R-108 63 Bioa Scia 


.4771 


.4536 


• 5661 


.4706 




8a R-X09 63 ScientaAtt 


• 4157 


.3922 


.4602 


.3757 




9a R-110 63 Aero-Space 


.3631 


.3663 


.4086 


.3616 




lOa K-111 63 Electronic 


.1705 


.3805 


• 4339 


• 3500 




11 a R-112 63 Mechanica 


.3293 


• 3738 


• 3636 


• 3333 




12a R-113 63 Farming 


.3 799 


.3951 


.4737 


.3777 




13a R-114 63 Home Eca 


• 3220 


.3790 


.3630 


• 3268 


1 


14a R-115 63 Sports 


• 4261 


• 4966 


.5205 


• 4140 


«i 


15. R-131 63 Art 


.5957 


.5522 


.5979 


.4524^ 


1 


16. R-132 63 Law 


.4674 


• 4643 


• 5614 


V ,^^96 


c 


17a R-133 63 Health 


.4509 


• 4326 


• 4904 


• 3945 


fl 


16a R-134 63 Engina 


.2752 


• 3138 


.3495 


.1265 




19, R-135 63 Archa 


.4627 


• 4246 


• 4607 


.4041 




20a R-138 63 Military 


.3933 


• 4163 


.4497 


.3663 




21a R-139 63 Acct,Buaia 


• 4502 


.4725 


.5126 


• 4389 




22a R-140 63 PraCdKnoWl 


.3275 


• 3356 


• 3634 


• 2970 




23a R-X42 63 Bible 


.4707 


.3960 


• 5124 


.3615 




24a R-145 63 Hunting 


• 0620 


• 0395 


• 0990 


• 0346 




25a R-146 63 Fishing 


• 060b 


• 0561 


.0446 


.0762 




26a R-147 63 Outdoor 


.4101 


.4233 


.4270 


.3966 




27a R-150 63 Theater 


• 546 7 


.5410 


.5507 


• 4605 




26. R-162 63 Vocab. 11 


.5156 


.5225 


.5937 


• 47*33 




29a R-212 63 Mema Words 


.3787 


• 3965 


.4415 


• 4035 


a 


30a R-220 63 Disga Wdsa 


• 4466 


.4560 


• 4413 


• 3646 


m 

A 


31a R-231 63 Spelling 


.3925 


• 3657 


• 4310 


.3509 


H 


32a R-232 63 Capitala 


• 2751 


• 2620 


• 3015 


• 2314 




33a R-233 63 Puncta 


• 4609 


• 4636 


• 5497 


• 4777 


H 


34a H-234 63 Eng a Usage 


• 4170 


• 4041 


.4511 


• 3697 


1 


35a R-235 63 Effa Expa 


.4062 


.3760 


.4229 


• 3720 


m 


36a R-240 63 WordaFunct 


• 4520 


.4617 


.5475 


• 5247 




w7a R-^250 63 Rdga Compr 


-.5751 


• 5372 


• 6479 


• 4975 




38a R-260 63 Creativity 


• 4374 


• 4345 


• 4721 


• 4369 




39a R-270 63 MephaReaa 


.3564 


.3722 


.4065 


.4073 




40. R-28I 63 Via# 2 Dim 


• 2214 


• 2251 


• 2211 


• 2607 




4l. R-282 63 Vis. 3 Din 


.3177 


• 3136 


• 3646 


• 364 3 




42. R-290 63 Abst.Reas 


• 3 766 


• 3622 


• 4501 


• 4165 


43 M 


pnr R-3li 63 AritheReaa 


•4674 


.4791 


• 5693 


.5521 


«4 m 


j44. R-312 63 Int.HSMath 


•4926 


.4819 


.5727 


• 6176 


2h 


!4S. R-333 63 Adv.HSMath 


• 3952 


• 3691 


• 4334 


• 5254 




4b. F-410 63 A^ithaComp 


• 2526 


• 2696 


• 3066 


.2638 




47. F-420 63 Table i^ead 


.1773 


• 1630 


• 1757 


.2043 




48. F-430 63 Clar. Check 


.1999 


• 2002 


• 2236 


• 2265 




49. F-440 63 Obj.lnap. 


• 1745 


.2056 


• 1595 


• 1799 




^ R-I02 60 Vocab. 1 


• 6494 


.6215 


• 6663 


• 5620 




51. R-I03 60 Litaratura 




• 5902 


• 6527 


• 5244 




52. R-I04 60 Muaic 


• 5902 




• 6179 


• 5266 




53. R-I05 60 Soc. Stud. 


.6527 


• 6179 




.5915 




54. R-I06 60 Math 


• 5244 


.5266 


.5915 






55. R-107 60 PhySa Scl. 


• 5357 


• 4910 


• 6219 


.5391 




56 . r- 106 60 Bio. Sci. 


.4900 


• 4446 


• 5377 


• 4363 




57a R-*I09 60 ScientaAtt 


• 4004 


• 4050 


.4593 


.3741 




58a R-IIO 60 Aero-Space 


• 366 3 


• 3460 


• 3766 


• 3403 




59a R-III 60 Electronic 


• 3134 


• 3058 


.1439 


.3307 


■ 


60a R-II2 60 Mechanica 


.3589 


• 3564 


• 4029 


.364 7 




61b R-II3 60 Farming 


• 4333 


• 4342 


.5245 


• 4182 


c 


62. R-114 60 Home Ec. 


• 4006 


•4429 


.4666 


.41 71 


o 

•fi 


63. R-II5 60 Sporta 


• 4311 


• 4543 


.4692 


• 4255 




64. R-131 60 Art 


• 5652 


• 5772 


• 5906 


• 4866 




65. R-132 60 Law 


• 4146 


• 3674 


• 4495 


• 3605 


<2 


66. R-133 60 Health 


.4729 


• 4665 


• 5357 


• 4133 


s 


67b R-134 60 Engin. 


• 3361 


• 3532 


• 3730 


.1417 




68a R-135 60 Arch. 


• 3923 


• 3616 


• 3953 


• 3366 




69. R-138 60 Military 


• 2966 


• 2767 


• 3278 


• 2761 




70. R-139 60 AcCt,Busi. 


• 4541 


• 4574 


• 5121 


• 432 6 




71. R-140 60 Prac.Knowl 


• 3642 


• 3624 


• 4194 


• 3273 




72. R-142 60 Bible 


• 4935 


• 4119 


• 5106 


• 3994 




73. R-145 60 Hunting 


• 0576 


•0543 


• 0676 


• 0493 




74. R-146 60 Fiahing 


• 0652 


.0631 


• 0620 


• 0601 




75b R-147 60 Outdoor 


• 4465 


•4551 


• 4764 


• 4169 




76. R-150 60 Theater 


• 5598 


.5339 


• 5471 


• 4505 




21. R-162 60 Vocab. 11 


.5397 


• 5399 


• 6074 


.4964 




78a R-2I2 60 Mem. Words 


.3904 


.3914 


.4374 


• 3972 




79. R-220 60 Disg. Wds. 


• 4 776 


• 4655 


• 4663 


• 4351 




'SST R-231 60 Spelling 


.3970 


• 3863 


.4453 


• 4143 




81. R-232 60 Capital. 


• 3140 


• 3123 


• 3591 


• 2686 




82. R-233 60 Punct. 


.4763 


.4846 


• 5531 


.5195 


r-4 


83. R-234 60 Eng. Usage 


• 4181 


• 3994 


• 4426 


• 3686 


j 


84. R-23S 60 Eff. Exp. 


• 3623 


• 3571 


• 3©76 


• 3406 




85. R-240 60 Word.Funct 


• 4756 


.4524 


• 5284 


• 5469 




86. R-2S0 60 Rdg. Compr 


• 6342 


• 5«334 


• 6969 


• 5463 




87. R-260 60 Creetivity 


• 4584 


.4339 


• 4723 


• 4429 




88. R-270 60 Mech.Reee 


• 3605 


• 3816 


• 3880 


• 4204 




89. R-281 60 Vis. 2 Dim 


• 2592 


• 2470 


• 2532 


• 2821 




90. R-282 60 Vis.* 3 Dim 


• 3223 


• 3010 


• 3468 


• 3663 




91. R-290 60 Abst.Reee 


• 3656 


• 4143 


• 448.1 


• 4252 




92. R-311 60 Arith.Rees 


• 4614 


• 4614 


• 5605 


• 5343 




03. R-312 60 Int.HSMeth 


• 5038 


• 4905 


• 5660 


• 6351 




94. R-333 60 Adv.HSMeth 


• 1216 


• 1226 


• 1253 


.1744 




557 F-410 60 Arith.Coap 


• 2586 


• 2935 


• 3531 


• 3150 


96. F-420 60 Table Read 


• 1317 


• 1303 


• 1272 


• 1199 


97. F-430 60 Cler.Check 


.2035 


• 1764 


.1955 


• 1763 




98. F-440 60 Cbjalnsp. 


• 1616 


• 1403 


• 1360 


• 1467 


99a F*80I 60 Socioecon. 


.3870 


.4521 


• 3920 


• 1502 


o 

ERIC 























55 


56 


57 


58 


59 


60 


61 


.5929 


.5286 


.5010 


.4036 


.3662 


.4367 


.5487 


.5504 


• 5166 


.4<.61 


.3895 


.1242 


.1568 


.4063 


.4793 


.4514 


.4144 


. 3565 


.2610 


a 1609 


.43 78 


• 5648 


.5185 


.4419 


. 1721 


. 3395 


.*3576 


.5022 


.5446 


.4615 


.396^ 


. )885 


• 34 35 


. 3475 


.4246 


. 7066 


.5490 


.4389 


.4311 


.4288 


.4184 


.5119 


.5280 


.6169 


. 3862 


.3414 


a 3181 


i.1980 


.5081 


.3 796 


.1919 


.51^5 


.2737 


.2128 


.1085 


.36 75 


• 3930 


.3587 


. 3096 


.4712 


.2740 


• 3406 


.3768 


• 4524 


.3839 


.29 76 


.3212 


.4572 


. 3776 


.3848 


• 3648 


.4017 


a 3289 


.279 1 


.3019 


.5 746 


.5096 


• 4044 


.4706 


.19 22 


.2475 


.26 73 


;447 1 


.6891 


• 3242 


.3977 


.3 342 


.2220 


.2358 


.3749 


.4460 


• 4166 


. 3735 


.3195 


.3009 


.2465 


.3149 


.3 799 


— .49^’"^ 




.4205 


. 3201 


b2583 


. 354 7 


.4633 


• 4426 


• 4162 


.4053 


.3074 


.2453 


. 3579 


.4655 


• 4359 


.4111 


. 3B12 


.284? 


.2220 


.2950 


.4286 


.3466 


.3037 


.2969 


.2084 


.2023 


.2987 


.4035 


• 3690 


.3132 


.2831 


.252 3 


.25 72 


.2568 


.1267 


• 3324 


.2962 


.2986 


.2699 


.1936 


.2658 


.2644 


• 4310 


• 3567 


.3818 


.27f'0 


.2410 


. 3269 


.4390 


• 2666 


.2676 


.1206 


. 1994 


. 1557 


.2185 


.2844 


• 4042 


• 3629 


.3748 


.2651 


.2249 


.2609 


.3675 


.1054 


.1087 


.0833 


.0596 


.077 7 


. 1589 


.1769 


.0626 


. 1 149 


.0435 


.0979 


.0925 


. 1651 


a 1074 


• 3956 


.376? 


. 33 76 


.2905 


.2482 


. 3207 


.3617 


• 4741 


.4013 


.1840 


. 3202 


.2437 


.118? 


.<♦243 


• 4809 


.4563 


• 4463 


.3117 


.2688 


.1567 


.4841 


• 3456 


.3436 


. ion 


.2146 


.1924 


.2467 


.1440 


• 4371 


. 1543 


.3315 


.2164 


.2124 


.2719 


• 3266 


.3534 


.1183 


.2551 


. 1692 


• 2064 


• 2038 


.3211 


.2492 


.2104 


. 1901 


.1274 


. 1283 


. 1476 


.2597 


• 4400 


.4030 


.3996 


• 2150 


.2429 


.2602 


.4220 


• 3665 


.3548 


.1309 


.2167 


.2223 


.2510 


.3781 


• 3506 


.3422 


.3581 


.1916 


.2021 


• 2438 


.1741 


• 5265 


• 4447 


. 3935 


.2594 


.2352 


• 3067 


.4285 


• 5 758 


.5042 


.4994 


.1291 


.2717 


.1998 


.5388 


• 4433 


.4104 


.3652 


.2909 


.2 755 


.3928 


•41 75 


.4547 


.1603 


.102 3 


.3127 


.2380 


.4002 


.3716 


• 2693 


. 1970 


. 1986 


.1717 


.1631 


.2275 


.2275 


• 3669 


.1206 


.3039 


.2424 


.1807 


.3410 


.3468 


• 4150 


. 3331 


.3686 


.2161 


.2158 


.2857 


.3747 


.5063 


.4411 


.4540 


• 2829 


.2936 


.3715 


.4905 


• 4903 


• 4454 


.1921 


.2868 


.2814 


.3175 


• 4142 


• 4000 


.3647 


.2792 


.2408 


.2233 


.2652 


.2919 


• 2266 


.2117 


.2150 


• 1059 


.1511 


.1781 


.2637 


• 1637 


.0940 


.0967 


. 1244 


• 1015 


• 1056 


• 1008 


• 2335 


• 1208 


.1193 


.1095 


.12/1 


.1171 


• 1345 


• 2063 


.1109 


.1110 


. 1263 


.0661 


.1629 


• 1581 


• 6141 


.5623 


.4822 


• 403 7 


• 3683 


.4 746 


.5351 


.5357 


• 4900 


.4004 


. 366 3 


.3134 


.3589 


.4333 


• 4910 


.4446 


• 4050 


• 3460 


.1058 


. 3564 


.4142 


• 6219 


.53 77 


.4591 


• 3 766 


• 3439 


• 4029 


.5245 


.5391 


.4361 


.3741 


. 340 3 


.1107 


• 3647 


.4162 




• 5176 


.3911 


. 3806 


.4660 


• 3657 


.4697 


• 5176 




.39 39 


.3211 


.3046 


.1869 


.4919 


• 3911 


. 1939 




.2501 


.2267 


• 1100 


.1826 


• 3606 


.1211 


.2501 




.2678 


.2933 


• 2711 


• 4660 


.3046 


.2267 


• 2678 




• 3294 


• 3064 


• 3857 


• 3869 


.3100 


.2933 


.3294 




• 4667 


.4697 


.4919 


. 3826 


• 2711 


.1064 


• 4667 




• 4160 


• 4189 


.3762 


• 2721 


.2954 


.4001 


.48C9 


• 3936 


.3653 


• 3071 


.3112 


.2561 


• 3343 


.3942 


• 4905 


.4501 


.4199 


. 3580 


.1212 


. 3983 


• 4368 


• 3362 


.3426 


.3103 


.2922 


.2454 


.3005 


• 1429 


• 4662 


.4549 


.3991 


• 3046 


• 2819 


.360 7 


• 4429 


• 3441 


.1169 


• 2769 


• 2367 


.2657 


.3578 


• 3376 


• 3296 


• 2976 


.2374 


.2214 


• 2335 


.2580 


.2750 


• 2506 


.2219 


. 1906 


• 2228 


• 1856 


• 2168 


• 2044 


• 4218 


. 3735 


.3643 


.2806 


.2795 


.3495 


• 3904 


• 3122 


• 2694 


.3242 


.20/0 


.2225 


.2719 


.1107 


• 4059 


.4133 


• 3664 


• 2644 


.2517 


.2975 


.4139 


• 0763 


.0802 


.0424 


.0362 


.0944 


. 1470 


.1316 


• 0461 


• 0702 


.0342 


.0577 


• 0392 


.0914 


.0799 


• 4082 


.3824 


.3554 


.2843 


• 2516 


• 1420 


• 1613 


• 4319 


. 3962 


• 3627 


• 1108 


.2687 


.3246 


.4030 


• 5U9 


• 4603 


.4353 


.3150 


• 3056 


• 3909 


• 4 794 


• 355C 


.34,52 


.2996 


.2125 


• 2166 


• 2103 


.3102 


• 4187 


• 3604 


.3595 


.2682 


• 2177 


• 2893 


.3625 


• 3638 


• 3109 


.2950 


• 1 7C 1 


.2086 


• 2131 


.3288 


• 3012 


.2497 


.2589 


. 1590 


.1732 


• 1922 


.2952 


• 4698 


• 4102 


• 4230 


• 2625 


.2527 


• 3104 


• 4394 


• 3 793 


.3204 


.3503 


• 2173 


.1854 


• 2619 


.3599 


• 3466 


.3040 


.3517 


• 2126 


• 1634 


.2046 


.3100 


• 4801 


• 4241 


.1898 


.2832 


• 2540 


• 2643 


• 3769 


.5774 


.5435 


.5302 


• 3704 


• 3328 


• 4235 


.5477 


• 4233 


.3996 


.3754 


. 1098 


• 2900 


.3996 


.4239 


• 4323 


.3596 


.3464 


.1297 


.2764 


.3980 


.3665 


.2543 


• 21 76 


.2224 


• 1726 


• 1532 


.2304 


• 2766 


.3423 


.2756 


.2827 


• 2213 


• 2018 


.2904 


.3309 


• 4238 


. 3321 


.3842 


• 2478 


.2200 


• 2684 


.3797 


• 5176 


• 4185 


.4556 


.2872 


.30 38 


.3607 


• 4489 


• 5062 


• 4076 


.3945 


.3032 


.2965 


• 1219 


• 4173 


• 1086 


.1035 


• 0865 


.1296 


.0632 


• 0961 


.0742 


.2757 


.2100 


• 2388 


.1106 


• 1606 


• 1970 


.2620 


• 1475 


• 1016 


.12 79 


.0688 


.0929 


.1259 


.1372 


• 1588 


.1207 


.1426 


.0869 


• 0617 


.0659 


.1410 


• 1321 


• 1318 


. 1268 


.1060 


.0704 


.1222 


• 1468 


• 3091 


.2317 


.27 73 


.2101 


. 1463 


• 1764 


.2118 



62 

.4213 

• 4234 

• 42U 
•iy?5 I 
•4208 I 

• 4L0? 
.3867 
. 3017 
.SZ21 
.4188 
.4314 
.6432 
.3890 
.3943 
.3927 
.3684 
.3433 
.3113 
.2310 
.3607 
.2976 
.2805 
.1012 [ 
.0739 [ 
.3799 ! 
.3640 I 
.4 329 ! 
.3122 ! 
•3094 I 
.2 774 
.2177 i 
.3768 1 
.3176 ! 
.3279 ; 
.3983 j 
.4490 1 
.4212 I 
.3363 
.2441 ' 

. 3648 ^ 

. 3638 
.4347 
.3 766 
.2 761 
.2603 
.1428 
.1203 ! 

. 1693 
.4981 i 
.4006 
.4429 ; 
.4666 
.4171 
.4160 
.4169 
.3762 
.2721 : 
.2934 * 
.4001 

.3621 

.4165 I 

.3160 I 

.4336 

.3566 

.2651 i 

.1633 i 

.3598 : 

.3365 i 

.3202 ; 

.0688 1 

•0498 ! 

.3911 

.3807 

.4568 

.2641 

.3473 

.2 765 

.2 763 

.3627 

.3101 

.3022 

.3366 

.4660 

.3649 

.3666 

c >425 

• 2920 

• 3 349 

• 4236 

• 4015 

• 0867 
.2647 
.1266 
.1136 
.1506 
.2433 




i 



63 


64 


1 

65 


66 


67 


• 4896 


• 6363 


.4509 


.5819 


• 4244 


• 4664 


• 6128 


• 4391 


• 5388 


• 3567 


.A6«7 


.5692 


• 3984 


44988 


.3845 


• «756 


• 5661 


.♦22H 


.5258 


.3598 


• 4667 


.5036 


.3794 


.4408 


.3379 


.<.♦10 


• 5258 


.4169 


.5072 


.3719 


• 3531 


• 4893 


.3567 


.4743 


.3596 


• 3344 


• 4331 


.3398 


.4023 


.3165 


• 3341 


• 3854 


.3260 


.3424 


• 2ir52 


• 2879 


• 3540 


.2978 


• 3342 


.3259 


• 3469 


• 3920 


.3135 


.3600 


.3612 


• 3932 


• 4253 


• 33n 


.4074 


.3400 


• 3264 


.3500 


.2794 


.3728 


• 31H4 


• 6066 


• 4393 


.3586 


.3997 


.3016 


• 4111 


• 6675 


.4001 


.4869 


. 3369 


• 4009 


• 4512 


.44 36 


.4131 


.3202 


• 3556 


• 4605 


.3329 


.5462 


.3142 


• 2450 


• 3340 


.2345 


.3504 


.4117 


• 3172 


.4092 


.282^ 


.3658 


.2708 


• 3122 


• 3588 


.2821 


.3110 


.2078 


• 3685 


• 4447 


.3703 


.4311 


.3271 


• 3039 


.3666 


.2588 


.3100 


.2493 


• 2647 


• 3910 


.3308 


• 3668 


.2433 


• 0365 


• 0345 


.0350 


.0429 


.0629 


• 0870 


.0662 


.0233 


.0477 


• 0965 


• 3400 


• 4212 


.3103 


• 3661 


f3251 


• 4247 


• 5334 


.3717 


• 4646 


.3088 


• 3951 


.5308 


,♦135 


.5165 


. 3439 


.3162 


• 3602 


• 2966 


.3431 


.2423 


.2793 


.4277 


.2697 


.3724 


.2620 


• 2749 


• 3719 


.2503 


.3836 


.2574 


.1926 


.2283 


.1870 


• 2626 


.1396 


• 35 34 


.4381 


.3414 


.4358 


.2909 


• 2936 


.3846 


.2972 


.3983 


.2135 


• 3021 


• 3692 


.2559 


.3738 


.2158 


• 3563 


• 4422 


.306 3 


.4199 


.3327 


• 4144 


.5790 


• 43H2 


.5215 


.3817 


.3558 


• 4694 


.3594 


.3878 


.3252 


• 3044 


• 3850 


.2566 


.2863 


.3038 


• 2139 


• 2389 


.K51 


. 1931 


.2017 


.2539 


.3332 


.2324 


.2644 


• 2628 


• 3243 


• 4044 


• 2844 


.3637 


.2038 


.♦030 


• 4394 


.3915 


.4309 


• 3066 


• 4068 


• 4323 


.3743 


• 3904 


.2894 


• 3128 


• 3427 


.2955 


.2693 


.2031 


• 2662 


• 2631 


.2065 


.2991 


. 1976 


• 2033 


• 1441 


• 1066 


.1622 


• 1213 


• 2068 


• 1824 


.1192 


.1748 


.1333 


• 2181 


• 1602 


• 0847 


.1694 


• 1484 


• 4871 


• 6191 


• 4566 


.5634 


.415? 


• 4311 


• 5852 


• 4148 


.4729 


.3361 


• 4543 


.5772 


.3874 


.4865 


.3532 


• 4692 


• 5906 


• 4495 


.5357 


.3730 


• 4255 


• 4888 


• 3605 


.4133 


.3417 


• 3936 


• 4905 


• 3382 


• 4662 


.3441 


• 3658 


• 4501 


• 3428 


• 4549 


. 3369 


• 3071 


• 4199 


• 3103 


.3991 


.2769 


.3112 


• 3580 


• 2922 


• 3046 


.2367 


• 2581 


• 3212 


• 2454 


.2819 


.2657 


• 3343 


• 3983 


• 3005 


• 3607 


.3578 


• 3942 


• 4388 


.3429 


• 4429 


.3376 


• 3621 


• 4|65 


• 3160 


• 4358 


.3566 




• 4208 


.3553 


.3706 


.2827 


• 42Q8 




•4091 


.5308 


.3958 


• 3553 


• 4091 




.3729 


.2710 


• 3706 


• 5308 


.3729 




. 3776 


• 2827 


• 3958 


• 2710 


.3776 




• 2724 


.3583 


.2725 


.3006 


.2311 


• 2453 


• 2902 


• 2694 


.2285 


• i 7b2 


• 3545 


.4773 


• 3978 


• 4338 


.3134 


• 3171 


• 4172 


• 3127 


.4044 


.2870 


• 3085 


• 4488 


.3797 


.4007 


.2776 


• 0508 


• 0692 


• 0704 


.0803 


.0897 


• 0002 


• 0751 


• 0403 


.0605 


.0769 


• 3808 


• 4825 


• 3347 


.4247 


.3448 


• 4l98 


.5795 


• 3920 


.4694 


.3490 


• 4062 


• 6305 


• 4908 


.5959 


.3759 


• 2860 


• 3806 


.2543 


.3191 


.2214 


• 3346 


• 4518 


• 2884 


.4483 


.2926 


• 3043 


• 3813 


• 2507 


.3760 


.2467 


• 2617 


• 3129 


• 2216 


.3277 


.2163 


• 3700 


• 4635 


• 3413 


.4389 


.3026 


• 2885 


• 3937 


• 2854 


.3926 


.2524 


• 2500 


• 3514 


• 2692 


.3497 


.2285 


• 3438 


• 4341 


• 3227 


.3932 


.2928 


• 4422 


• 6180 


• 4573 


.5741 


.3872 


• 3549 


• 4571 


• 3433 


.4072 


.3415 


• 3114 


.3841 


.2994 


.3311 


.3181 


• 2201 


• 2658 


• 1968 


.2405 


.2112 


• 2355 


• 3082 


• 2109 


• 2492 


.2454 


• 3116 


• 4124 


• 2928 


• 3567 


• 2598 


• 3693 


• 4509 


• 3885 


• 4209 


• 3185 


• 4004 


• 4582 


• 3487 


• 4169 


• 3201 


• 1261 


• 1042 


• 0844 


• 0782 


• 0875 


• 2564 


• 2833 


• 1985 


.3207 


.2034 


• 1443 


• 1544 


• 0824 


.1891 


.1172 


• 1508 


• 1587 


• 1389 


.1789 


• 0986 


• 1440 


• 1628 


• 0796 


.1561 


.1303 


• 3298 


• 3895 


• 2510 


.3013 


• 1988 


o 
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TABLE 


6-lb (continued) 




68 


69 


70 


71 


72 


.35?0 


.2970 


.54 15 


• 4313 


• 4801 


.3413 


.2724 


• 5168 


• 3857 


.5256 


.3111 


• 2048 


.4570 


.3532 


.4322 


.3433 


.2960 


.5128 


.4017 


.5082 


.3042 


• 2848 


.4744 


. 3356 


.4251 


.3160 


.2729 


.4792 


.3525 


.4598 


.2682 


.2197 


.39 74 


• 3166 


.4225 


.2001 


.1785 


.3659 


• 3825 


.3596 


.2210 


.1891 


.3253 


.2501 


• 3104 


.22/5 


.2036 


• 3267 


.2290 


.3050 


.2100 


• 2052 


• 3285 


.2799 


.3185 


.2614 


• 1978 


.3780 


.2882 


• 4056 


.2403 


• 1609 


.3145 


.2821 


.3216 


.2/81 


• 24H6 


.3581 


.3140 


.295 5 


.3201 


• 2667 


>4366 


.4166 


• 4258 


.2725 


.2872 


.3919 


.3295 


.3709 


.2556 


.2228 


.3338 


.2952 


• 3880 


.1/81 


.1645 


.2285 


.2530 


.25 77 


.3594 


.2015 


♦ 329 7 


.2588 


.32 36 


.2340 


.3388 


.3071 


.2504 


• 3063 


.2686 


.2529 


• 5194 


.3622 


• 3308 


.2130 


.2099 


• 2857 


• 4285 


• 2939 


.2554 


• 2500 


• 33 70 


.2677 


• 762 3 


.0397 


.0418 


.0307 


.0072 


.0724 


.0438 


.0445 


.0271 


-.0096 


• 0242 


.2546 


.2349 


.3322 


• 3145 


• 3104 


.2878 


.2753 


.4200 


• 3735 


.3752 


.2885 


.2739 


.45 79 


• 4146 


.3984 


.2599 


• 1983 


.2761 


• 2430 


.3792 


.2356 


• 1373 


.3317 


.2921 


• 3052 


.2537 


• 1466 


• 3091 


• 2443 


• 2939 


.1667 


• 0331 


• 2055 


• 2043 


• 1829 


.2 764 


.1932 


.3708 


• 3307 


.3925 


.2379 


• 1674 


.3117 


.2449 


.3299 


.2278 


• 1544 


• 2950 


.2977 


.2999 


.2862 


.1751 


• 4177 


• 3288 


• 4122 


.3147 


• 2545 


• 4831 


• 4256 


.5455 


.2755 


• 1990 


.4002 


• 3409 


.3720 


.2286 


• 1746 


.2978 


• 2771 


.2762 


.1540 


.0962 


.1912 


• 1971 


• 1703 


.2241 


. 1279 


• 2690 


.2589 


• 2921 


.2306 


.1720 


.3174 


• 3183 


.3135 


.2823 


• 2143 


• 4329 


.3138 


.41 77 


.2774 


• 2266 


.3875 


• 3077 


• 4143 


.2419 


• 1856 


• 3011 


• 2099 


.2954 


.2111 


• 1169 


• 2427 


• 2500 


• 24 38 


.1041 


• 0658 


• 14 74 


• 2138 


.•0984 


.1419 


.0566 


• 1835 


• 1727 


• 0765 


.1487 


• 0616 


• 1294 


• 1782 


• 0891 


• 3908 


• 3146 


• 5269 


• 4157 


• 4831 


.3923 


• 2988 


• 4541 


• 3642 


• 4935 


• 3616 


• 2767 


• 4574 


• 3824 


• 4119 


.3953 


• 3278 


• 5121 


• 4194 


• 5106 


.3366 


• 2781 


• 4328 


• 3273 


• 3994 


.3296 


• 2506 


• 4218 


• 3122 


• 4059 


.2976 


• 2219 


• 3735 


• 2894 


• 4133 


.2374 


• 1906 


• 364 3 


.3242 


• 3664 


.2214 


• 222B 


• 2806 


• 20 70 


• 2644 


.2335 


• 1856 


.2795 


• 2225 


• 2517 


.2580 


• 2188 


• 34 95 


• 2739 


• 2975 


.2750 


• 2044 


• 3904 


• 3107 


• 4139 


.2651 


• 1833 


• 3598 


.3365 


• 3202 


.2724 


.2453 


.3545 


• 31 71 


• 3065 


.3583 


.2902 


• 4773 


• 4172 


• 4488 


.2725 


.2694 


• 3978 


• 3127 


• 3797 


.3086 


.2285 


.4338 


• 4044 


• 4007 


.2311 


• 1762 


• 3 1 34 


• 2870 


• 2776 




• 2176 


• 3140 


• 2425 


• 3086 


.2176 




• 2653 


• 1717 


• 2515 


.3140 


• 2653 




• 3448 


.3833 


.2425 


• 1717 


.3448 




• 3107 


.3086 


• 2515 


• 3833 


• 3107 




.0910 


• 0526 


• 0651 


• 0692 


• 0755 


.0677 


• 0555 


• 0636 


• 0376 


.0613 


.2664 


• 2210 


• 3971 


• 3 740 


• 3445 


.3243 


• 2682 


•4711 


• 3921 


• 3848 


.3293 


• 2661 


• 6090 


.4300 


• 4554 


.2342 


• 1662 


.3210 


• 2625 


.3163 


.2727 


• 2128 


• 3626 


• 3154 


• 3435 


.2508 


• 1828 


• 3151 


• 2576 


• 3032 


.1729 


• 1 3 7 1 


• 2583 


• 2959 


.2530 


.2823 


• 2060 


• 4067 


• 3420 


• 4099 


.2527 


• 1676 


• 3269 


• 2903 


• 3331 


• 1881 


• 1283 


• 3117 


• 2822 


• 2687 


• 3018 


• 2137 


• 4109 


• 2987 


• 4045 


• 3754 


• 2796 


• 5269 


• 4330 


• 5613 


• 3191 


• 2298 


• 4004 


• 3212 


• 3491 


• 2392 


• 2123 


• 3118 


• 2756 


• 2916 


• 1645 


. 1266 


• 1983 


• 2308 


• 1946 


• 2164 


• 1561 


• 2689 


• 2154 


• 222 7 


• 2435 


• 1827 


• 3304 


• 3134 


• 3192 


• 2897 


• 2188 


• 4602 


• 3425 


• 4102 


• 3036 


• 2266 


• 4142 


• 3342 


• 4130 


• 0765 


.0955 


• 1003 


• 0799 


.090 7 


• 1869 


.1250 


• 2656 


.2871 


.2219 


• UB53 


• 0204 


• 1207 


.1797 


• 1299 


• 1253 


• 0706 


• 155.? 


. 163a 


• 1317 


• 0984 


.0609 


• 1377 


.1471 


• 0822 


• 2289 


.1821 


• 3114 


.2710 

1 


• 1776 













73 


74 


75 


Variable 


.1073 


• 0537 


• 5313 


1. R-102 63 


• 0396 


• 0566 


• 4687 


2. R-103 63 


• 0514 


• 0555 


• 4771 


3. R-104 63 


• 0936 


• 0502 


• 4695 


♦. R-IOS 63 


.0660 


• 0611 


.4 394 


S. R-106 63 


.0991 


.0606 


• 4722 


6. R-107 63 


• 0858 


• 0940 


• 4128 


7. R-lOB 63 


.0484 


• 0431 


.3925 


B. R-109 63 


• 0890 


• 0595 


• 3521 


9. R-110 63 


.0959 


• 0589 


• 3189 


10. R-111 63 


• 1426 


.0762 


• 3440 


11. R-112 63 


• 1376 


• 0646 


.3749 


12. R-113 63 


.0822 


• 0551 


• 3555 


13. R-llA 63 


• 0530 


• 0961 


• 4079 


!♦. R-llS 63 


.0732 


• 0710 


• 4459 


IS. R-131 63 


.0602 


• 0443 


• 3920 


16. R-132 63 


• 0673 


• 0478 


.3779 


17. R-133 63 


.1173 


• 0387 


• 3142 


IB. R-13A 63 


• 0215 


• 0196 


.3457 


19. R-13S 63 


• 058 7 


• 0248 


• 2661 


20. R-13B 63 


• 0639 


• 0586 


• 3836 


21. R-139 63 


.0314 


• 0462 


• 3363 


22. R-IAO 63 


• 0581 


• 0200 


• 3030 


23. R-1A2 63 


• 2 394 


• 0^25 


• 000 7 


2A. R-IAS 63 


• 0722 


• 23 77 


• 1024 


25. R-.146 63 


• 0611 


• 0409 


• 5121 


26. R-147 63 


.0652 


• 0785 


• 4089 


27. R-ISO 63 


• 0929 


• 0875 


.4373 


2B. R-162 63 


• 0313 


• 0365 


• 3331 


29. R-212 63 


• 0270 


-•0203 


• 3554 


30. R-220 63 


• 0232 


.0384 


• 2965 


31. R-231 63 


• 0467 


-.0150 


• 2255 


32. R-232 63 


.0404 


• 0155 


• 3859 


33. R-233 63 


• 0401 


• 0154 


• 3210 


34. R-234 63 


.0205 


• 0162 


• 3644 


35. R-23S 63 


• 0226 


• 0403 


• 3860 


36. R-240 63 


• P57B 


• 0358 


• 4642 


37. R-250 63 


• 0506 


• 0712 


• 3858 


36. R-260 63 


• 0370 


• 0326 


• 3402 


39. R-270 63 


-•0119 


.0320 


.2377 


40. R-2B1 63 


• 0416 


• 0161 


• 3255 


41. R-282 63 


• 0506 


• 0227 


• 3658 


42. R-290 63 


• 0703 


• 0214 


• 4368 


43. R-311 63 


• 0410 


• 0164 


• 4042 


44. R-312 63 


-•0208 


• 0157 


• 3208 


45. R-333 63 


• 0751 


• 0147 


.2733 


4b. F-410 63 


• 0334 


-•0098 


.2164 


47. F-420 63 


• 0176 


-•0034 


• 1716 


4b. F-430 63 


• 0343 


• 0065 


• 2036 


49. F-440 63 


• 0823 


• 0530 


• 5042 


SO. R-102 60 


.0578 


• 0652 


• 4465 


51. R-103 60 


• 0543 


• 0631 


• 4551 


52. R-104 60 


• 0676 


• 0620 


•4764 . 


S3. R-105 60 


• 0493 


• 0601 


• 4169 


54. R-106 60 


• 0763 


• 0461 


• 4082 


55. R-107 60 


• 0802 


• 0702 


• 3824 


56. R-iOB 60 


• 0424 


• 0342 


• 3554 


57. R-109 60 


• 0382 


• 0577 


• 2843 


SB. R-110 60 


• 0944 


• 0392 


• 2516 


59. R-111 60 


• 1470 


• 0914 


• 3420 


60. R-112 60 


.1316 


• 0799 


• 3813 


61. R-113 60 


• 0888 


• 0498 


•3911 . 


62. R-114 60 


• 0508 


• 0802 


• 3808 


63. R-115 60 


• 0692 


• 0751 


• 4825 


64. R-131 60 


.0 704 


• 0403 


• 334 7 


65. R-132 60 


• 0803 


• 0605 


• 4247 


66. R-133 60 


• 0897 


• 0769 


• 3440 


67. r-134 60 


• 0910 


• 0677 


• 2664 


60. R-13S 60 


• 0526 


• 0555 


• 2210 


69. R-13S 60 


• 0651 


• 0636 


.3971 


70. R-139 60 


• 0692 


• 0376 


• 3 740 


71. R-140 60 


• 0755 


• 0613 


• 3445 


72. R-142 60 




• 0516 


• 0847 


73. R-14S 60 


• 0516 




• 0050 


74. R-146 60 


• 0847 


• 0858 




il: KS 88 


• 0495 


• 0339 


• 4303 


.0751 


• 0749 


.5327 


77. R-162 60 


.0286 


• 0369 


• 2869 


7B. R-212 60 


• 0383 


• 0613 


• 3041 


79. R-220 60 


• 0435 


• 0443 


• 2941 


SO. R-2::^l 60 


• 0337 


• 0295 


• 2720 


81. R-232 60 


• 0504 


• 0293 


• 3830 


02. R-233 60 


• 0418 


• 0147 


• 3214 


B3. R-234 60 


• 0205 


• 0026 


.2873 


84. R-23S 60 


• 0304 


• 0292 


• 3720 


05. R-240 60 


• 0578 


• 0556 


.5016 


06. R-250 60 


•089 7 


• 0655 


• 3821 


07. R-260 60 


• 0826 


.0517 


• 3065 


00 . R-270 60 


• 0407 


• 0142 


• 2871 


09. R-2B1 60 


• 036 3 


• 0238 


• 2885 


90. R-2B2 60 


• 0401 


• 0352 


• 3615 


91. R-290 60 


• 0756 


• 0295 


• 4181 


92. R-311 60 


.0446 


• 0453 


• 4210 


93. R-312 60 


• 0290 


• 0273 


• 0817 


94. R-333 60 


• 0106 


• 0485 


• 2692 


95. F-410 60 


.0517 


• 0099 


.1708 


96. F-420 60 


.0294 


• 0469 


• 1635 


97. F-430 60 


.0205 


.0241 


• 1771 


98. F-440 60 


-.0005 


-.0004 


• 3766 


99. P*801 60 






1 




1 
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TABLE 6-lb (continued) 



I 










i 






I 





Variable 


76 


77 


78 


79 


80 




“T7 R-102 63 Vocab* I 


• 5804 


.6656 


.4408 


.5463 


.4584 




2. R-103 63 Literature 


.5712 


.6242 


.4434 


.4923 


.4425 




3. R-104 63 Music 


.5287 


.5613 


. 3843 


.4910 


.3841 




4. R-105 63 Soc. Stud. 


• 5153 


.6076 


.4343 


.4606 


.4126 




5. R-106 63 Math 


.4708 


.5394 


.4216 


.4541 


.4283 




6. R-107 63 Phys. Sci. 


.4616 


.5691 


.4146 


.4460 


.4019 




7. R-108 63 Bio. Sci. 


.3684 


.5045 


.3415 


.4102 


.3128 




8. R-109 63 Scient.Att 


.3744 


.4713 


• 3017 


.36 71 


.2939 




9. R-110 63 Aero-Space 


.3627 


.3608 


.2373 


.2880 


. 1956 




10. R-111 63 Electronic 


.3031 


.3806 


.2514 


• 2789 


.2434 


u 


11. R-112 63 Mechanica 


.3148 


.4083 


.2418 


.2958 


.2052 


s 


12. R-113 63 Farming 


.3726 


.4604 


.2796 


.3562 


• 3037 




13. R-114 63 Home Ec* 


• 3085 


.3963 


.2205 


.2604 


.1989 


1 


14. R-115 63 Sports 


.4378 


.4274 


. 3216 


.3796 


.3053 


u 


15. R-131 63 Art 


• 5481 


.5761 


.3293 


.4386 


. 3466 
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.3004 


.2972 


• 0787 


• 1591 


.1325 


.0612 


.0972 


.2069 


18. R-134 63 


• 2645 


• 1 340 


.2)46 


• 2988 


• 3320 


• 3446 


.06 74 


• 1850 


• 0851 


• 1438 


.0831 


• 3039 


19. R-135 63 


.2^26 


. 1558 


. 1 705 


• 2651 


• 3297 


• 3150 


.0370 


• 1564 


• 1104 


• 0928 


• 0810 


• 2633 


20. R-138 63 


• 3283 


.2501 


.2758 


• 3617 


• 4916 


• 4421 


.0746 


• 3140 


• 1635 


• 1032 


• 1037 


• 2811 


21. R-139 63 


.2477 


• 2093 


.2090 


.2695 


. .3052 


.3140 


.0939 


• 2435 


.1751 


• 1343 


• 1262 


• 2496 


22. R-140 63 


• 2967 


. 1814 


.2502 


.3273 


.3976 


.4049 


.0546 


• 1865 


• 1326 


• 0716 


• 0646 


• 1608 


23. R-142 63 


• 0603 


• 0134 


.0248 


• 0425 


• 0629 


• 0185 


• 0323 


.0279 


• 0391 


.0198 


• 0263 


-.0500 


24. R-14S 63 


• 1013 


.0719 


.0521 


• 0639 


• 0303 


• 0414 


.0444 


• 0109 


• 0065 


• 0223 


• 0196 


-.0102 


2S. R-146 63 


• 3726 


.2723 


.2610 


.3320 


.3709 


• 3886 


.1289 


• 2011 


• 1516 


• 1092 


.1451 


• 3962 


26. R-147 63 


• 3330 


.2465 


• 2568 


.3780 


.4217 


• 465 7 


• 0698 


.2493 


• 1708 


.1455 


• 1162 


.3709 


27. R-;S0 63 


. 3797 


• 26U 


• 2938 


.4135 


.5055 


• 4717 


.0714 


• 2844 


• 1460 


• 1223 


• 0974 


• 3345 


28. R-162 63 


• 3012 


.2358 


• 2594 


• 3781 


• 4083 


• 4124 


• 0867 


• 2998 


• 1274 


• 2050 


^1453 


• 2521 


29. R-212 63 


• 3194 


• 2886 


.2703 


• 3820 


• 4129 


• 4080 


.063? 


• 3274 


.1950 


• 3164 


• 2099 


• 3068 


30. R-220 63 


• 2367 


.1739 


• 1820 


.2980 


. 3890 


• 4017 


• 0665 


• 3 787 


• 1666 


• 2840 


• 1363 


• 1861 


31. R-231 63 


• 1935 


.1877 


• 1931 


.2412 


• 2563 


• 2366 


• 0457 


• 2736 


• 2267 


.2145 


.1551 


• 1741 


32. R-232 63 


• 4155 


• 3210 


.3517 


.496 3 


.5369 


.5385 


.0841 


• 4392 


• 2559 


.2 775 


• 2128 


• 2637 


33. R-233 63 


• 3511 


.2498 


.2465 


• 382/ 


• 4208 


• 4221 


.0498 


• 3442 


• 1609 


• 2278 


• 1415 


• 2454 


34. R-234 63 


• 3306 


• 28tl 


.2793 


• 4073 


• 420b 


• 3944 


• 0658 


• 3632 


.1610 


.1607 


• 1435 


.2777 


35. R-23S 63 


.3949 


.3132 


.371 3 


.4989 


• 5641 


.594 7 


' .0754 


• 4168 


• 1978 


• 2589 


• 1893 


• 2894 


36. R-240 63 


.4195 


• 3023 


.3732 


• 4896 


• 5821 


.5443 


.0830 


.4114 


.1835 


.2205 


• 1838 


.3406 


37. R-2S0 63 


• 4106 


• 2952 


.3829 


.4455 


.4 776 


• 4611 


.1042 


• 3096 


.1627 


• 1919 


.1886 


• 2910 


36. R-260 63 


• 6350 


• 4080 


• 4912 


.4762 


.4602 


• 4608 


• 1052 


.2621 


• 1615 


• 1406' 


• 2287 


• 2901 


39. R-270 63 


• 3602 


• 5653 


• 4213 


• 3666 


.2938 


• 2861 


• 0423 


• 2325 


• 1429 


• 1559 


• 2280 


• 1456 


40. R-281 63 


• 4695 


• 4143 


.5855 


• 4751 


• 4422 


• 4280 


.0707 


.2719 


• 1445 


• 1708 


• 2699 


.2164 


41. R-282 63 


.4599 


• 4008 


• 4644 


• 6004 


.4941 


• 4816 


• 0796 


.3 395 


• 2221 


• 1945 


• 2691 


• 3105 


42. R-290 63 


• 4916 


• 3469 


• 4046 


.5243 


• 6817 


.6031 


• 0958 


• 3858 


• 1869 


.2212 


• 1923 


• 3300 


43. R-311 63 


• 4476 


.3207 


.3934 


.46/7 


• 5769 


.6751 


.1272 


• 3626 


• 1749 


• 2637 


.1881 


• 3691 


44. R-312 63 


• 3699 


• 2261 


.3168 


• 34 71 


.4415 


• 5242 


.1496 


• 2329 


• 0805 


• 1620 


• U34 


• 2867 


45. R-333 63 


• 22 76 


.2554 


• 2104 


.3126 


.3588 


• 3680 


.0646 


• 4828 


• 2335 


• 2746 


.2211 


• 1450 


46. F-410 63 


• 1749 


.2005 


.1592 


• 2224 


• 1841 


• 2361 


• 0486 


• 2453 


' .2295 


• 2066 


• 2465 


• 1085 


47. F-420 63 


. 1674 


.2002 


.1599 


• 2396 


.2145; 


• 2229 


• 0445 


.2311 


• 1612 


• 2830 


.2350 


• 2050 


4e. r-430 63 


.2327 


.2723 


.2437 


.1051 


• 1935 


.1211 


- .0310 


• 2148 


.1894 


• 2002 


• 4068 


• 1571 


49. F-440 63 


• 4639 


.3050 


.3489 


• 4637 


• 5647 


.5528 


• 1107 


• 3393 


* .1810 


• 2226 


• 1806 


• 4125 


SO. R-102 60 


• 3605 


.2592 


• 3223 


.1856 


• 4614 


• 5038 


• 1216 


• 2586 


• 1317 


• 2035 


• 1618 


• 3870 


51. R-103 60 


• 3816 


• 2470 


.3010 


.4143 


• 4614 


.4905 


• 1226 


• 2935 


. .1303 


• 1784 


.1403 


• 4521 


52. R-104 60 


• 3660 


• 2532 


• 3468 


• 4481 


• 5605 


.5680 


• 1253 


.3531 


• 1272 


.1955 


• 1 360 


• 3920 


S3. R-IOS 60 


• 4204 


• 2821 


• 3663 


• 4282 


• 5343 


« .6351 


• 1744 


• 3150 


• 1199 


• 1783 


• 1487 


.3502 


54. R-106 60 


• 4323 


.2543 


.342 3 


• 4238 


.5176 


• 5062 


.1086 


.2757 


• 1475 


• 1588 


• 1321 


.3091 


55. R-107 60 


.3596 


.2176 


• 2756 


o 3321 


• 4185 


o4076 


• 1035 


• 2300 


.1016 


• 1207 


• 1318 


• 2337 


56. R-108 60 


• 3464 


• 2224 


.2827 


.3842 


.4556 


• 3945 


.0865 


• 2388 


• 1279 


• 1428 


• 1268 


.2773 


S7. R-109 60 


• 3297 


.1 726 


• 2213 


• 2478 


.2872 


• 3032 


• 1296 


• 1308 


.0688 


.0869 


• 1060 


• 2301 


58. R-110 60 


• 2764 


.1532 


.2018 


• 2200 


.3038 


• 2965 


• 0832 


.1806 


• 0929 


.0817 


.0704 


• 1463 


59. R-111 60 


.3980 


• 2 304 


• 2904 


.2684 


• 3607 


• 3219 


• 0961 


.1970 


, .1259 


• 0859 


• 1222 


• 1764 


60. R-112 60 


• 3665 


• 2766 


.3309 


. 379 7 


.4489 


• 4173 


• 0742 


• 2820 


.1372 


• 1410 


. 1468 


• 2118 


61. R-113 60 


• 3668 


• 2425 


• 2920 


• 3349 


• 4236 


• 4015 


• 0667 


• 264 7 


• 1266 


• 1158 


• 1506 


.2433 


62. R-114 60 


• 3114 


.2201 


• 2355 


• 3116 


.1693 


• 4004 


.1261 


• 2564 


> .1443 


• 1508 


.1440 


• 3298 


63. R-llS 60 


• 3841 


• 2656 


• 3082 


.4124 


.4509 


• 4562 


• 1042 


• 2833 


vl544 


.1587 


• 1628 


• 3895 


64. R-131 60 


• 2994 


. 1968 


.2109 


• 2928 


• 3S85 


• 3487 


• 0844 


• 1985 


: .08 24 


.1389 


.0798 


.2510 


65. R-132 60 


• 3311 


.2405 


.2492 


• 3567 


• 4209 


• 4169 


• 0782 


• 3207 


• 1891 


• 1789 


• 1561 


.3013 


66. R-3.33 60 


• 3161 


.2112 


• 2454 


.2598 


.3185 


• 3261 


• 0875 


.2034 


wlll2 


• 0986 


.1303 


• 1988 


67. R-134 60 


• 2392 


.1645 


• 2164 


.2435 


.2897 


.3038 


.0765 


• lB69 


.0853 


.1253 


• 0984 


• 2289 


68. r-135 60 


• 2123 


• 1266 


• 1561 


• 1827 


.2IB8 


• 2266 


.0955 


• 1250 


• 0204 


.0706 


• 0609 


• 1821 


69. R-138 60 


• 3110 


• 1983 


• 2689 


• 3304 


• 4602 


• 4142 


• 1003 


• 2656 


.1207 


• 1552 


.1377 


• 3114 


70. R-139 60 


• 2756 


• 2308 


.2154 


• 3134 


• 3425. 


• 3342 


• 0799 


.2871 


.1797 


.1638 


• 1471 


• 2710 


71. R-140 60 


• 2916 


.1946 


.2227 


.3192 


.4102 


• 4130 


• 0907 


.2219 


• 1299 


• 1317 


.0822 


• 1776 


72. R-142 60 


• 0826 


• 0407 


• 0363 


• 0401 


• 0756 


.0446 


• 0290 


• 0106 


• 0517 


• 0294 


• 0205 


-.0005 


73. R-14S 60 


• 0517 


.0142 


.0238 


.0352 


.0295 


• 0453 


.0273 


• 0485 


• 0099 


• 0469 


.0241 


-.0004 


74. R-146 60 


.3865 


• 2871 


• 2685 


• 3615 


• 4181 


• 4210 


• 0817 


.2692 


• 1708 


• 1635 


• 1771 


• 3 766 


R-147 60 


• 3273 


.2299 


.2342 


• 3498 


• 4264 


• 4412 


• 0992 


• 2778 


• 1541 


. 1868 


.1537 


• 3712 


76. R-150 60 


• 3950 


• 2543 


• 3106 


.4125 


• 5262 


• 4859 


.0887 


• 3226 


• 1656 


.1726 


• 1572 


.3464 


77. R-162 60 


• 2936 


• 2106 


.2626 


.3366 


• 4023 


• 4130 


.0920 


• 2 776 


• 1213 


• 1962 


• 1593 


• 2376 


78. R-212 60 


• 3726 


• 3174 


.2797 


.4261 


• 4355 


• 4415 


• 0959 


.3328 


• 2308 


• 3497 


• 2407 


• 3071 


79. R-220 60 


• 2152 


• 1922 


• 2014 


.3200 


• 4438 


.4843 


.1077 


.3537 


• 1611 


.2669 


• 1066 


• 2205 


80. R-231 60 


• 2395 


.2136 


.2233 


• 3438 


• 3814 


• 3874 


.0735 


• 312S 


• 1981 


• 1875 


.1773 


• 2193 


81. R-232 60 


• 4123 


• 3124 


• 3606 


.3065 


.5852 


.6170 


.1211 


• 4029 


• 2037 


.2557 


• 1850 


• 2925 


82. R-233 60 


• 3106 


• 2356 


.2299 


• 3665 


• 4364 


.4342 


• 0713 


.3 344 


• 1835 


• 2006 


• 1347 


• 2472 


83. R-234 60 


.3197 


.2255 


• 2511 


• 3690 


.4493 


• 4016 


• 0748 


• 2 744 


.1304 


• 139A 


.1214 


• 2402 


84. R-23S 60 


• 4135 


• 2936 


.3717 


• 4849 


.5716 


• 5795 


.0863 


• 3390 


• 1978 


• 2416 


• 2081 


• 2886 


85. R-240 60 


• 4631 


• 3438 


• 4095 


• 5565 


• 6323 


.5906 


. .0919 


• 3871 


• 2172 


• 2525 


• 2158 


• 3680 


86. R-2S0 60 


.4419 


« 3097 


.3703 


.4473 


.4741 


• 4613 


• 1100 


• 2816 


• 1568 


.1832 


• 1950 


• 2941 


87. R-260 60 




.4238 


• 5246 


.5058 


. .4698 


• 4445 


.1071 


• 2053 


.1654 


.1507 


.2587 


• 2741 


88. R-270 60 


.4236 




• 4233 


. 1932 


' .3219 


.3422 


• 0612 


.2078 


• 2273 


.2147 


• 2808 


• 1823 


89. R-281 60 


• 5246 


.4233 




.4983 


• 4111 


.4039 


.1011 


• 1990 


• 1843 


• 1430 


• 25 39 


• 2245 


90. R-282 60 


• 5056 


.3932 


.4983 




.5139 


• 4972 


.0949 


.3275 


• 2139 


.2077 


.2925 


• 3280 


91. R-290 60 


• 4698 


• 3219 


• 4111 


.5139 




• 6175 


• 1156 


• 3669 


.1688 


. 1856 


.1469 


• 2890 


92. R-311 60 


.4445 


• 3422 


• 4039 


.49/2 


• 6175 




• 1803 


.3947 


• 1930 


• 2142 


• 1721 


• 3407 


93. R-312 60 


• 1071 


• 0612 


.1011 


• 0949 


• 1156 


.1803 




• 0428 


• 0129 


• 0328 


• 0221 


• 0710 


94. R-333 60 


.2053 


.2078 


.1990 


.32/5 


.3669 


.3947 


.0428 




• 2529 


.2179 


• 1944 


• 1679 


95. F-410 60 


. 1654 


• 2273 


• 1843 


.2139 


.1688 


• 1930 


.0129 


• 2529 




• 3142 


• 3347 


• 1024 


96. F-420 60 


.1507 


• 2147 


• !430 


.2077 


.1856 


.2142 


• 0)28 


• 2179 


• 3142 




.3325 


• 1416 


97. F-430 60 


.2507 


• 2808 


• 2539 


.2925 


.1469 


.1741 


.0221 


• 1944 


.3347 


. 3325 




. 1459 


98. F-440 60 


.2741 


• 1823 


• 2245 


• 3280 


• 2890 


• 3407 


•ono 


• 1679 


• 1024 


• 1416 


• 1459 




99. P*801 60 



^his matrix was obtained by the special procedure described in Chapter 3 tor estimating correlations when data 
are misning, and for insuring that the matrix will be consistent* Retest weight t was used* 

*^The unweighted numbers of cases on which each correlation coefficient is based may be determined from Tabic 2-5. 






CANONICAL CORRELATION ANALYSIS 



As a preliminary to the factor analysis that is discussed later in this 

V 

chapter, a canonical correlation analysis was undertaken. The purpose of the 
factor analysis was to provide some explanatory constructs to account for as 
many as possible of the interrelations among the cognitive variables (both 
within-grade and between-grade relationships). The canonical correlation 
analysis, in contrast, was intended to focus on the organization of the relation- 
ships between the set of grade 9 variables and the set of grade 12 variables. 

This analysis was based on the matrices in Table 6-1, and it was done sepa- 
rately for males (Consistent Matrix lA) and females (Consistent Matrix IB). 

For each matrix the set of 49 grade 12 variables was correlated with the 
corresponding set of grade 9 variables. 

Since all four of the 49-variable within-grade matrices (two for males 
and two for females) were of full rank (rank 49), 49 canonical correlations 
were obtained for males and 49 for females. No exact test of significance 
is available for these correlations since there is no single number of cases 
for the consistent correlation matrices. If N is assumed to equal 600 (a 
gross understatement of the average number of cases Involved in the statistics 
of these matrices, as can be seen in Table 2-5), 17 of the canonical correla- 
tions for males would be statistically significant (at the .05 level) and 17 
for females. Thus 17 may safely be regarded as a lower-bound estimate of the 
number of significant canonical correlations for each sex. 

This means that there are at least 17 distinct dimensions which the 
grade 9 and grade 12 variables share. Each of the composite variables 
represented by those dimensions has a correlation significantly greater than 
0 with at least one grade 9 variable and one grade 12 variable. It will be 
noted that the expression used above is " at least ” 17 dimensions. Because of 
the very conservative basis used in estimating this lower bound, it seems 
almost certain that there really are more than 17 such dimensions in the popula- 
tion of students from which our sample was drawn, and that a different approach 
might uncover some additional non-chance dimensions. As a matter of fact, 
as we shall see later in this chapter, when the factor analysis results are 
discussed, that is exactly what we think has happened; there are more than 17 



factors linking the grade 9 and grade 12 measures, and we are hypothesizing that 
many of the additional factors represent non-chance relationships. 

Table 6-3 shows the canonical correlations. The reader is urged to 
avoid attaching undue significance to the fact that the first canonicals are 
remarkably high (1.000 for males and .999 for females). The explanation of 
this phenomenon is clearly that when there are as many as 49 variables in each 
set, and particularly when there are strong built-in linkages between the 
sets there is considerable room for capitalization on chance (i.e., on sampling 
errors), in the early . canonicals. 

No effort will be made in this present discussion to describe or interpret 

1 

the canonical variafes since the meaning of unrotated factors of this sort is 
obscure. A discussion of the intrinsic nature of specific factors linking the 
grade 9 and grade 12 variables is therefore postponed to a later section 
of this chapter, where the rotated factors resulting from the factor analysis 
are discussed. 

At this point, let us restrict ourselves to a consideration of the concept 
of joint factors linking, two grades, rather than concerning ourselves about 
the nature of individual factors of this type. To the extent that there are 
significant canonical linkages between grade 9 scores and grade 12 scores — 
in other words linkages that exist not just in the sample we happen to be 
using but in the population it represents— there are underlying factors basic 
to performance in grade 9 and likewise basic to grade 12 performance. These 
factors may be in essence aptitudes as of grade 9. They may be personality 
factors or motives .that have affected achievement up to grade 9 and continue 
to affect it through grade 12, and that themselves remain essentially unchanged 



^The author is indebted to two colleagues, Bary G. Wingersky and Charles E. Hall, 
for pointing out that rotation of canonical factors (and similarly rotation 
of discriminant functions) would facilitate interpretation, in much the same 
way that factor rotation facilitates interpretation of an ordinary factor 
analysis. 






6-23 



TABLE 6-3. Canonical correlations between grade 9 and grade 12 cognitive variables 

(separately by sex) 

Based on consistent matrices lA (males) and IB (females) 









Percent of 


reliable 




■ 




within-grade 


variance 


k 






accounted 


for by 




Canonical r 


first k canonical r's** 




M 


F 


M 


F 


1 


1.000 


.999 


3.0 


3.4 


2 


.981 


.954 


6.0 


6. 6 


3 


.932 


.861 


8.9 


9.6 


4 


.793 


.785 


11.3 


12.2 


5 


.733 


.724 


13.5 


14.7 


6 


.719 


.690 


15.7 


17.1 


7 


.680 


.641 


17.7 


19.2 


8 


.627 


.588 


19.6 


21.2 


9 


.614 


.584 


21.5 


23.2 


10 


.570 


.529 


23.2 


25.0 


11 


.533 


.508 


24.9 


26.8 


12 


.517 


.496 


26.4 


28.4 


13 


.508 


.478 


28.0 


30.1 


14 


.471 


.469 


29.4 


31.7 


15 


.461 


.452 


30.8 


33.2 


16 


.452 


.444 


32.2 


34.7 


17 


.431 


.426 


33.5 


36.2 


18-49 


.414-. 009 


.395-. 007 


53.6 


59.0 



* “ 
These canonical correlations are based on 98 variables (49 for grade 9 

and the corresponding 49 for grade 12) in the Table 6-1 matrices. The 
only Table 6-1 variable not included in these canonicals is P*801. 

The formula used for estimating these percentages is given in Appendix 
H-3 (Formula 5). It will be observed that the average of the reliability 
coefficients for the individual variables in a set enters into this 
formula. The averages used for this purpose are based on 42 reliability 
coefficients each (from Table 4-8, cols, 1-4), since coefficients are not 
available for R-212, R-220, R-281, F-410, F-420, F-430, or F-440. The aver- 
ages used are as follows: 



Grade 



r 

XX 



M F 



Number of 
coefficients 



9 


.6567 


.5765 


42 


12 


.6870 


.6240 


42 



o 
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during this entire time span. Or they may be home or community factors 
socioeconomic and other environmental factors. At this point we cannot do 
more than surmise what they are. But we can say with certainty that they 
(whatever they may be) are elements that are present in grade 9 and are still 
present, unchanged, in grade 12. Let’s consider a hypothetical example. 

Suppose one of the canonical factors (after rotation) were to turn out to be 
an aspect of spatial ability. This canonical factor would have high correla- 
tions with the ’’spatial'* tests in the TALENT battery — Visualization in Two 
Dimensions and ^visualization in Three Dlmensions--at both grade levels. The 
meaning to be attached to this canonical factor would be that there is some 
element or component of spatial ability that is an attribute of the grade 9 
student and that he still possesses at the same relative level (i.e., at the 
same level relative to other members of the group of individuals under con- 
sideration) in grade 12. It would most emphatically not mean that the entire 
complex of abilities that affects performance on a "spatial" task such as these 
called for by the "Visualization in Two Dimensions" and "Visualization in 
Three Dimensions" tests is invariant between grades 9 and 12. There would 
still, presumably, be ample room for change since the "spatial" canonical 
factor would almost certainly not account for all the reliable variance in 
the two visualization tests. Some of the other components— the "noncanonical" 
ones— affecting grade 12 scores might very well be improved by certain kinds 
of training. For instance some students’ relative scores on the "Visualization 
in Three Dimensions" test might rise as a consequence of course work in solid 

geometry.^ 

Now let’s drop this discussion of hypothetical examples and get back 
to real findings. The fact that at least 17 of the 49 canonical correlations are 
significant means that there are at least 17 independent ways in which students 



^This particular supposition, though presented as a hypothetical example, was 
not pulled out of the air. French (1965) found that a variable representing 
the individual’s general approach to items measuring spatial visualization 
operates as a rather potent "moderating variable," substantially affecting 
the factorial composition of many tests that involve higher mental processes. 
This moderating variable indicates the degree to which the individual tends 
to approach spatial visualization items analytically and to try to reason out 
the answer, perhaps using geometric concepts in the process, as opposed to 
attempting to perceive the figures globally. 
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differ when they enter high school and continue to dlffeti^ at least for the 
next three or four years. 

Are these 17 ways abilities, or are they something else — interests or 
other motivational factors, perhaps? At this stage we can't answer with 
certainty — but since all 49 variables of the battery In question are cognitive 
measures derived from objective tests rather than noncognltlve measures such 
as personality or Interest variables, it seems reasonable to surmise that 
most (and perhaps, but not necessarily, all) of the 17 canonical factors 
represent dimensions of ability , unaltered by the students' experiences In 
grades 10, 11, and 12. 

Because it is an Important point and one on which misunderstanding may 
occur, let us reiterate: we are not denying that grade 12 scores on tests in 

which any of these 17 stable factors are Involved are affected significantly 
by whatever has happened In grades 10, 11, and 12. They can be and are 
affected by these experiences— but that is only because the 17 abilities we . 
are talking about are not the sole determiners of the grade 12 test scores. 

Other ability factors too can enter Into them and affect them in an important 
way — and these other abilities are presumably the direct outcome of changes 
that occur in grades 10, 11, and 12. These may be changes for the better or 
changes for the worse; they may be due to deliberate efforts on the part of 
the school, individual teachers, family, friends, counselors, or the student 
himself to effect changes of a particular kind — or they may be wholly adcldental 
by-products of efforts to bring about other changes. To give a hypothetical 
example, if a school were to decide to require all students to take four years 
of high school mathematics and were to make room (in the students' schedules 
and in the school's budget) for this change by eliminating all foreign language 
courses, the average level of mathematics achievement In the school would 
almost certainly rise substantially — and this would be a deliberately sought 
effect — but foreign language mastery would almost certainly be affected In an 
undesirable direction — and this would be an Incidental and unsought effect of 
the decision to concentrate a large share of the school's resources on its 
mathematics program. 

A logical next question is: Just how much of the Variance do these 

canonical factors account for? There appears to be some disagreonent among 
statisticians as to how to determine the "percentage of variance accounted 
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for" by a set of canonical correlations. The view taken here is that the '.ques- 
tion should be asked separately for sets of variables correlated rather than 
for the overall battery combining the two sets. 

At this point a little clarification of terminology is in order, to 
differentiate between the terms "canonical variate" and "canonical factor," 
as used in this chapter. By "canonical variates" are meant the linear combina- 
tion of grade 9 scores and the linear combination of grade 12 scores which 
when correlated with each other yield a canonical correlation coefficient. 

By "canonical factor" is meant the hypothetical factor assumed to underlie the 
two corresponding canonical variates and to account for the canonical correla- 
tion between them. Having established these definitions, let us reword the 
question asked in the preceding paragraph. How much of the variance of each 
canonical variate is accounted for by the canonical factor underlying it? 

The answer to that question depends on how the factor loadings for the 
two corresponding canonical variates are determined. The only restrictions they 
are subject to is that neither can exceed 1 and their product must equal the 
canonical r. Any values assigned them, within these restrictions, are legitimate, 
and merely serve to define the canonical factor — in other words to fix its 
location in "factor space." The square of the loading then represents the 
proportion of the canonical variate *s variance accounted for by the canonical 

factor. 

In the special case where we choose to assign equal loadings to the two 
canonical variates, each of the loadings must equal the square root of canonical 
r. Let us note that under these circumstances the canonical correlation would 
represent the proportion of the canonical variate’s variance explained by the 
canonical factor. Let us emphasize: the proportion would equal the correla- 

tion itself, not its square.^ 



^The situation here is entirely analogous to the situation in ordinary factor 
analysis, where there is good reason to prefer the multiple correlation to 
its square as an estimate of a variable’s communality. This preference is 
discussed at considerable length in the section on "Factor Analysis Methodol- 
ogy," later in this chapter. Let it suffice at this point to say that not 
only are all the arguments for multiple R that are presented in that section 
entirely applicable to the use of canonical r in the present context, but they 
are, if anything, even stronger here since in the two-variable context the 
correlation coefficient may be regarded more as an exact value of the 
communality than as a mere estimate, (The two variables of the present context 
are the grade 9 canonical variate and the corresponding grade 12 canonical 

variate. ) 



In the present case, instead of assigning equal loadings to the two 
canonical variates so that the proportions of this total variance accounted for 
by the canonical factor are equal, it seems advantageous to define the loadings 
in such a way that it is the proportions of the reliable variance that are 
approximately equal. When the loadings are determined in accordance with this 
principle, and when, furthermore, the number of variables in the two within- 
grade matrices are equal, as they are in this case (49 variables in each matrix), 
and when both the matrices are of full rank, the percentage of the total reliable 
variance of a within-grade matrix that is accounted for by the first k canonical 
factors is given by the following formula^: 




where 



Vi 



.th . 

1 — canonical 



r between grade 9 and grade 12 



r 

aa . 



= average reliability coefficient for the 
grade 9 variables 



^bb average reliability coefficient for the 

grade 12 variables 

n = number of variables for grade 9 

= number of variables for grade 12 

Having disposed of some of the methodological problems involved, let us 
look at Table 6-3 again. The two columns at the. right show the cumulative 
percentage of the grade 9 reliable variance (or the grade 12 reliable variance) 
accounted for by the canonical factors. These percentages were computed by 
means of the formula above. 



This formula is derived in Appendix H-3. 
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It is seen from this table that the complete set of 49 canonical relation- 
ships accounts for about 54 percent of the within-grade reliable variance among 
males and about 59 percent among females. What we are tryirsg to establish in 
this discussion is some notion of the relative extent to which achievement as 
of grade 12 is a direct outcome of the student's potential when entering high 
school and the extent to which it is the result of departures from what would 
have been predicted on the basis of the grade 9 record. Although this may 
appear to be a resurrection of the old nature-versus-nurture argument, it isn't. 

Full recognition is given to the fact that the student's ability pattern at 
grade 9 is a result not only of his heredity but also, and to a very important 
extent, of the environment he has been in and the experiences he has had up 
to that time. However we can get an estimate of the proportion that is normally 
subject to modification during the high school years, if we accept the assump- 
tion that the variance accounted for by the canonical correlations represents 
that component of the student's performance that is invariant (relative to 
other students) during the high school years. Furthermore the statement that 
it is invariant is not intended to imply that it is unmodifiable under any 
conceivable circumstances. All that is meant is that it is not normally subject 
to modification under present circumstances in schools of the type now in 
existence, with school practices of the type now followed. In any event, if 
we subtract from 100 some reasonable approximation of the percentage of reliable 
variance due to invariant factors, what we have left is an estimate of the 
percentage of variance modified (or modifiable under present circumstances) 
during the high school years. In connt'.ction with this use of canonical correla- 
tion data a question may arise as to whether we are overestimating the proportion 
of variance in the "invariant" category when we base this estimate in part on 
the early canonical correlations, in view of the fact that they are undoubtedly 
somewhat Inflated as a result of the capitalization-on-chance phenomenon men- 
tioned earlier in this section. However this poses no insuperable difficulties, 
particularly when the entire set of canonical correlations is used in the estimate; 
we can probably then assume that about the same amount of capitalization on 
chance is likely to have occurred in the portion representing modifiable 
variance since the same number of factors (principal components) is probably 
involved (49 within grade 9 and 49 within grade 12), to account for the same 
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set of variables (the 49 variables for grade 9 or the 49 for grade 12). 
Following the proposed procedure, we obtain as our final estimate something 
In the vicinity of 56 percent for the Invariant components and 44 percent 
for the modifiable components. Somewhat surprisingly this latter percentage 
Is considerably greater than the percentage of variance attributed to environ- 
ment In most of the studies that compare Identical and fraternal twins 
(Nichols, 1965). This percentage usually turns out to be around 30 percent. 
The discrepancy between the results of twin studies and our results here Is 
not entirely Inexplicable, however. In the first place, because of the many 
assumptions and approximations that are necessarily Involved our results can 
only be regarded as rough estimates, not as precise values. But even more 
Important, the battery on which our results are based Is broader in scope 
than a conventional Intelligence test, which Is what many of the twin studies 
use. 



INVARIANT COMPONENTS MEASURED BY INDIVIDUAL TESTS 

In the previous section we drew some conclusions from the canonical 
correlation analysis. These conclusions can be refined and sharpened by a 
consideration of analogous data for Individual tests. For this purpose zero- 
order correlations may be regarded as a special case of canonical correla- 
tions. Since all the same logic therefore applies that was used In the 
Appendix H-3 derivation, we can determine the percentage of the reliable 
variance that is accounted for by what we are terming the "Invariant factor" 
underlying the correlation between the grade 9 and grade 12 scores on a test. 
Let us reemphasize at this point that by the word "Invariant" we mean to 
Imply merely that this Is a factor that typically doesn* t vary between grades 9 
and 12 — and not that It couldn * t vary. Conceivably It could, under greatly 
modified circumstances. 

This percentage of the reliable variance that Is "Invariant" In the 
sense explained above Is given by formula 1 of the previous section. In 
the case of a zero-order correlation between grade 9 and grade 12 scores on 
a test, the formula reduces to correction for attenuation. The correlation 
coefficient corrected for attenuation equals the proportion of reliable 
variance in either grade that Is accounted for by the common factor affecting 
score in both grades. 
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For this purpose Table 5-4 provides the basic data. We see from columns 
3-4 in that table that about 80 percent of the Abstract Reasoning (R-290) 
variance (78 percent for girls, 82 percent for boys) is invariant in the 
grade-9-to-12 interval, about 80 percent of the Reading Comprehension 
(R-250) variance, about 90 percent of Arithmetic Reasoning (R-311) and close 
to 100 percent of Vocabulary I (R-102) (although this latter percentage 
is probably at least a slight overestimate, resulting, perhaps, from an under- 
estimate of the reliability). In any event these four (R-102, R-250, R-290, 
and R-311) are the tests most akin to those in typical intelligence tests. 

It appears, thus, that perhaps only about 20 percent of the Reading Compre- 
hension variance and 20 percent of Abstract Reasoning variance are typically 
subject to modification during the high school years, and even smaller 
percentages of Arithmetic Reasoning variance and Vocabulary I variance. 

These percentages are somewhat lower than the 30 percent attributed to environ- 
ment in most of the studies that compare identical and fraternal twins. But 
this is not surprising. Even though these percentages represent variance 
components that have become fixed by the time a student enters high school 
and are therefore invariant during the high school years, there is no reason 
to think that this is explainable solely in terms of heredity. Presumably 
by grade 9 the effects of heredity have become augmented by effects of home, 
community, schooling up to grade 9, and other environmental factors. Thus, 
taking the methodological differences into account our results seem quite 
compatible, on the whole, with those obtained in twin studies; the broad 
similarities in the findings are perhaps more noteworthy than the small 
differences. Moreover the present results may be regarded as supplementing 
the results of twin studies, by providing some rough idea of the proportion 
of the potential for modification that is "used up" before a boy or girl 
reaches grade 9. 
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FACTOR ANALYSIS OF CONSISTENT CORRELATION MATRICES 



1 

Factor Analysis Methodology: Some Issues. Opinions. Evidence, and Decisions 

Several technical decisions on methodology are Involved In any factor 
analysis. Sometimes the decisions are not made explicitly; In these cases 
they are Implicit In the procedure chosen, or, more likely. In the computer 
program available and therefore used. It Is this writer’s conviction, based 
In part on empirical evidence and In part on theoretical considerations, 
that contrary to a widely prevalent belief, many of the decisions made do 
sometimes make a substantial difference In the results and In the way they 
should be Interpreted, and that therefore the decisions that are made should 
be made knowingly and with due thought, not accidentally or by default. 

In the research under consideration now, a main purpose of the factor analysis 
Is to compare the factorial composition of two sets of data obtained three 
years apart and determine whether the number and nature of the common factors 
has changed In those three years. For such a purpose It Is especially 
Important that careful thought be given to methodological Issues. A poor 
decision could easily lead not merely to loss of factors or to Inconclusive 
results but to downright misleading conclusions of a substantive nature. 
Therefore special attention has been paid to methodological problems In the 
present research. In an effort to give the substantive conclusions as sound 
a basis as possible. The procedural decisions that were made In connection 
with the factor analysis described In this chapter and the reasons for them 
are presented below. 

ISSVES AND DECISIONS 

Issue 1. What kind of matrix Is to be factor analyzed ? The choices are 
a covariance matrix, a correlation matrix, or some sort of matrix Involving 



Readers Interested only In the substantive results of the research are 
advised to skip this section, which deals solely with methodological 
matters. 
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modification of the data-based coxrelations (such as alpha factor analysis, 
or image covariance, for instance). The choice is easy. The present problem 
is to gain an understanding of the way abilities underlying the TALENT test 
battery are organized rather than to interpret the TALENT battery as a ran- 
dom sample of some inconceivable hypothetical Infinite population of tests. 
The alpha factor analysis procedure approaches the population-of-tests con- 
cept as a goal (Kaiser and Caffrey, 1962), and is therefore out of the ques- 
tion. Its underlying assumption that the battery to be factor analyzed is 
a random sample of an infinite population of tests would be in direct 
contradiction to the way the TALENT battery was constructed, which was any- 
thing but a random procedure. It might be mentioned in this connection that 
Loevinger (1965) has most effectively demolished the concept of a test as a 
random sample of a hypothetical infinite population of items, and also, 
more generally, of a battery as a random sample of tests. 

Having eliminated alpha factor analysis from the list of possibilities, 
we must decide what to do about image covAriance analysis, which, though it 
doesn't postulate a hypothetical infinite population of tests, does replace 
the original data-based correlations with "image covariances" before factor 
analysis. This, too, is unacceptable for present purposes since our purpose 
is to explain the correlations among the variables. In thus rejecting the 
image covariance procedure as not meeting the needs of the present study, 
are we also giving up Important advantages not available in other methods 
we might use? The answer appears to be negative. It is true that image 
covariance, along with the principal components method and unlike most other 
factor-analytic procedures, permits exact computation, as opposed to mere 
estimation, of factor scores for individuals (Kaiser, 1958). But this is 
a matter of no moment for our purposes. In the first place this property of 
direct computability of factor scores, however valuable it is in situations 
\/kere factor scores for individuals are needed, is of no utility whatever 
in studies in which determination of individual factor scores is neither an 
immediate nor intermediate nor ultimate purpose of the research. And in the 
present research it is none of these. Moreover even if individuals' factor 
scores were needed, "exact" factor scores based on image covariance would 
not necessarily have any a.^vantage over "estimated" factor scores obtained 
from some other factor-analytic procedure employing communality estimates in 
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the diagonal and retaining the original correlations as the off-diagonal 
terms. Though the "exact" factor scores obtained from image covariance would 
necessarily be completely uncorrelated for the sample of individuals on which 
the image covariance analysis was based, they would almost certainly lose 
this property of orthogonality in a "cross-validation sample." 

As for the computed-correlatlon-t;8. -computed-covarlance issue (quite 
apart f->rom the issue of modification of the raw computed values as in the 
image covariance procedure), again the purpose of the research guides us 
to our decision. In the present study we are concerned with understanding 
the organization ^f abilities underlying the existent test battery and 
Independent of the metric of the tests; we do not regard the specific metric 
Oa! the tests as they stand as having some Inherently Important meaning; 
therefore the matrix to be factor analyzed should contain correlations not 
raw covariances. 

Issue 2. What values should go into the diagonal of the correlation 
matrix — l*s or communalitv estimates? The answer in this case, since the 
primary goal is to gain an understanding of the factors accounting for the 
Intercorrelations and explaining the underlying variables, rather than to 
obtain estimates of factor scores , is that the diagonal should contain 
reasonable estimates of the communallty. This keeps the unique factors 
(test specificity and tinrellablllty) from getting mixed into the so-called 
common factors in which a unique factor cannot logically have any place. 

Issue 3. What value should be used for the communalitv estimates? 
Inherent in the answer is the principle that any estimation procedure that 
necessarily produces an inconsistent matrix (a non-Gramlan matrix) is a bad 
procedure. The term "inconsistent matrix" as used here means a matrix that 
no possible factor structure could be compatible with unless one were 
willing to represent loadings and scores on some of the factors by using the 
algebraic construct of imaginary numbers. Since such factors are worthless 
as explanatory constructs they are unacceptable. The squared multiple 
correlation (SMC), which is widely favored as an estimate of communallty, is 
known to have this defect, which is too often Ignored by advocates of the 
method. Use of any systematic underestimates of communallty in the diagonal, 
such as SMC's for Instance, automatically produces a non-Gramlan matrix 
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(except in the trivial cases when all the multiple correlations equal 0 or 
unity, in which situation, though use of SMC’s would produce a Gramian matrix, 
doing a factor analysis would of course be wholly pointless). 

However the use of the multiple correlation coefficient Itself (unsquared) 
does not have this defect. The author has Investigated the snatter sufficiently, 
both empirically and by developing some supportive evidence of a theoretical 
nature, to be convinced that multiple correlation coefficients give much 
more reasonable results when used as communality estimates than do SMC’s. 

Any time the writer has used multiple correlation in the diagonal it 
has given eminently satisfactory results. It has invariably resulted in 
either a Gramian matrix or one. so close to Gramian (i.e., one with only a 
very small number of negative eigenvalues, and those few quite close to 
zero and corresponding to factors that have only negligible loadings) that 
departures from the mathematical properties of a Gramian matrix might 
reasonably be ascribed to sampling errors. However the mere fact that use 
of the multiple correlation coefficient in the diagonal produces a matrix 
that is for all practical purposes Gramian would hardly be impre'isive. One 
can achieve a Gramian matrix, with no trouble at all, by merely putting I’s 
in the diagonal. But I’s are not communality estimates. The fact that 
multiple correlation coefficients are excellent communality estimates is 
evidenced by the substantial reduction they produce in the number of common 
factors, as shown by the large number of eigenvalues that are approximately 
zero. (This doesn’t normally happen when I’s are put in the diagonal.) 

Thus as suggested above, a wealth of empirical evidence is available 
that multiple correlation coefficients are useful estimates of communality. 

But in addition to the empirical evidence that they work well and the practical 
consideration that they are very easy to obtain, there is substantial theo- 
retical evidence supporting the view that they provide good estimates of 
communality. DuBois (1962), for Instance, makes the following point in 
their favor as first approximations: 

"Since with zero-order r the proportion of common variance (as 
contrasted with the proportion of predicted variance) is close 
to r itself, the multiple correlation between a given variable 
and all the other variables in the matrix is taken as a good 
working approximation of the communality." 
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Probably one source of confusion has been, as DuBols implies, confusion 
between the variance on one variable that is predictable from the rest of 

them (which is unquestionably R ) and proportion of the variable's variance 

attributable to common factors, a proportion that is generally higher than 
and never lower. Although it can be demonstrated algebraically that multiple 
correlations are not necessarily precisely equal to communalities, they 
are neither systematic underestimates (as their squares are) nor systematic 
overestimates (as I's are). A multiple correlation may be either larger 
than the theoretical communality or slightly lower (in which case a slightly 
non-Gramian matrix results), but it is never as much of an underestimate as 
the SMC is. This suggests that multiple R is likely to be much closer to an 
unbiased estimate of the communality than SMC is. 

As may be inferred without too much difficulty from the foregoing 
discussion, the multiple correlation coefficient was the statistic chosen 
to estimate communality in the present research. 

Issue 4 . What initial computation method is to be used to extract the 
factors ? This presents no great problem, since any method that yields 
an orthogonal factor structure that reproduces the original correlation 
matrix reasonably well is satisfactory. From this viewpoint the principal 
components method (or to be more precise the principal factor method^, 
since the diagonal of the matrix factored does not consist of I's) is as 
good as any and better than most. 

Issue 5 . How many common factors should be obtained (or retained, if 
a full solution is carried out )? Kaiser (1960) has suggested, in effect, 
that the number of eigenvalues greater than 1 (the size of the average 
eigenvalue) for the original correlation matrix with I's in the diagonal 
usually coincides with the number of common factors worth retaining. This 
assertion has been widely misinterpreted to mean these are the only components 



Although the nomenclature is not entirely standardized, we are following 
the practice, in this report, of using the term "principal factors" rather 
than "principal components" when the diagonal of the original correlation 
matrix contains communality estimates rather than I's. 
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that represent something more than sampling error — a notion which, as Kaiser 
indicates (Kaiser, 1960, 1964; Kaiaer and Caffrey, 1962), is patently false. 
Several logical considerations make its falsity apparent; for instance the 
fact that this criterion is independent of number of cases, unlike any 
reasonable test of statistical significance, and the fact that absurd con- 
clusions may result from it (such as that about half the principal components 
are useful when in fact the original correlation matrix to be factored does not 
differ significantly from a matrix of 0 correlations, i.e., an identity matrix). 
But quite apart from these logical considerations, Humphreys (1964) has shown 
empirically that particularly when N is large the eigenvalue rule of thumb 
may give far too few factors, and thus discard useful information. 

For these reasons both the Kaiser criterion itself, which is based on 
principal components analysis, and its principal factor analogue, which could 
be considered to consist in discarding factors with eigenvalues smaller than 
the average one in the set, i.e., smaller than the average communality estimate, 
are rejected for the present research. This leaves us dependent on subjective 
judgment, unfortunately, but the hazards seem less of a risk than the known 
Inaccuracies that the eigenvalue rule of thumb would present in the present 
case. A major basis for the subjective decisions is of course the utility 
of the results, which in turn depends in large part on their interpretability. 

Issue 6 . Should the factors be rotated ? The answer to this question 
is an unequivocal yes. When the purpose of the factor analysis is to aid 
understanding of the organization of the abilities underlying the variables 
factor analyzed, the factor solution should be one which will facilitate 
achievement of this purpose. This requires interpretable factors, and there 
is no reason to believe that principal factors will be particularly interpretable. 
A suitable rotation can be expected to bring a substantial improvement in 
this respect. 

Issue 7 . Should the rotated factors be oblique or orthogonal? This 
is largely a matter of personal preference on the part of the researcher, 
when the purpose of the factor analysis is to aid understanding of the under- 
lying abilities. The present writer prefers orthogonal factors because they 
result in a solution that is simpler to interpret. This facilitation of 
interpretation derives from the concept of orthogonality, which has at least 
one major inherent advantage: it clarifies the apportionment of variance. 
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Issue 8 . What criterion should be used in rotating the factors ? What 
analytic procedure is chosen for rotating factors to a new orthogonal solution — 
and, for that matter, whether any analytic solution is to be used in preference 
to subjective rotation — depends solely on what is the shortest, fastest 
route to an interpretable and reasonable solution with the desired statistical 
characteristics. One of the most important of such characteristics, in the 
writer’s view, is "positive manifold." In other words, if tne original 
correlation matrix is essentially positive throughout, the final matrix of 
factor loadings should be essentially positive; there should be no signifi- 
cantly bipolar factors. Of no importance whatever, at least for the purposes 
of the present study, is the quartimax criterion of maximizing the variance 
among squares of loadings or the varimax criterion of maximizing the sum of 
these variances within factors — except insofar as these criteria help achieve 
the subjective goals of reasonableness and interpretability and the closely 
related objective goal of positive manifold. 

As to whether the quartimax tendency under certain circumstances to 
produce a sizable general factor or the opposing varimax tendency to minimize 

or eliminate such a factor is to be preferred, again the answer lies in the 

extent to which a general factor is reasonable and interpretable and contrib- 

utes to the purpose of the study. The varimax solution is more likely to 
meet the criterion of "simple structure" than is quartimax, but in the 
writer’s opinion that is not in itself an important advantage. The criterion 
of simple structure, one characteristic of which is the absence of a general 
factor, may represent a statistical convenience but it certainly does not, 
in the usual situation, represent any logical necessity. Elimination of 
a general factor doesn’t even necessarily produce a simpler neater explana- 
tion of the results since it doesn’t cut down the number of common factors, 
which is determined by the rank of the matrix, not by the presence or absence 
of a general factor. 

In the present research it seemed desirable to avoid any preconceived 
notion that there would be no general factor, or at most, one of minimal 
importance. It was felt, in other words, that if there turned out to be a 
general factor that appeared to be substantial and important and if the 
solution was otherwise satisfactory, the general factor should not be 
artificially suppressed or reduced in influence. 



The above paragraphs are a defense of eclecticism in choice of rotational 
procedure. In other words use of any such procedure that works is espoused. 
Thus if an analytic rotation procedure is tried and proves not to give useful 
results on a given set of factors, there is no objection to trying another — 
and still another if there is another available that seems promising. 

Furthermore — and most important — there is no objection (except on the 
grounds of inconvenience) to deciding subjectively about the factors to 
rotate and the positions to which to rotate them, if subjectively determined 
rotations of this sort give more satisfactory results (i.e., a solution with 
a clearer, more reasonable interpretation) than can be obtained by purely 
analytic methods. The sole purpose of factor rotation is usually to make 
interpretation easier and better. (Any analytic or subjectively determined 
rotations aft€?r quartimax would presumably still be subject to the restriction 
of factor orthogonality.) 

Taking all the above considerations into account, the strategy settled 
upon was to try quartimax first. If quartimax were to prove unsatisfactory 
varimax would be the next choice, and if this too failed the final tactic 
would be to resort to subjective rotation. As we shall see, this series of 
eventualities was exactly what occurred. 

SUMARY 

The factor analysis methodology considered for use in the present research 
is discussed above at some length. The methodological decisions themselves, 
without the reasons for them, may be summarized very briefly as follows: 
factor analysis of correlation matrices, using the principal factor procedure 
for the original solution, with multiple R's as the communality estimates in 
the diagonal of the correlation matrix; subjective decision (based in large 
part on interpretability) as to number of principal factors to be retained; 
rotation of the initial factor solution to another orthogonal solution, using 
the quartimax criterion as the first effort in this direction; retaining the 
option of substituting varimax — and even following that by additional 
orthogonal rotations if quartimax failed to yield a satisfactory solution; 
and using positive manifold (where appropriate), simplicity (which is regarded 
as not necessarily synon3nnous with the formal criteria for "simple structure"). 
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and — ^most important of all — ready interpretability, as the primary criteria 
of whether a solution is satisfactory. 

SPECIAL PROBLEMS 

The preceding discussion is concerrted only with problems that are 
relevant to the usual factor analysis for which a correlation matrix based 
entirely on cases with no missing data is available. This happy situation 
does not apply in the present instance. However the special problems in 
obtaining a suitable correlation matrix when a very large proportion of the 
data is missing have been discussed at considerable length in Chapter 3, 
and the trio of techniques presented there and utilized in developing the 
99-variable matrices presented in Tables 6-la and 6-lb seems to work well. 
The use of the resulting consistent matrices in the factor analyses is 
therefore proposed. The trio of techniques referred to above consists of: 

1. Weighting the cases^ to make the groups taking the six batteries 
A, B, C, D, E, and F as nearly equivalent as possible, by 
capitalizing on the presence of the Abstract Reasoning test in all 
six batteries. 

2. Use of a newly developed special procedure for estimating correla- 
tion coefficients when some of the data are missing. 

3. Testing the resulting correlation matrix for consistency (i.e., 
Gramianness) and if it turns out to be slightly non-Gramian using 
another newly developed procedure to make it Gramian with only 
minimal alterations of the correlation coefficients composing it. 

Purpose and Plan of the Factor Analysis 

The basic purpose of the factor analysis on the retest data was to 
explore the question of whether the factor pattern was consistent from 
grade 9 to grade 12 or whether there were systematic changes in it. In 
view of this purpose it was essential to include exactly the same test 
variables for the two grades. Socioeconomic index (P*801) was also included 
in order to determine the extent to which it was related to the various 
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factors and to determine whether socioeconomic factors play a major role In 
any shifts In pattern that occur betwt^en grades 9 and 12. 

An auxiliary purpose was to determine whether any shifts In factor pattern 
between grades 9 and 12 that might be uncovered by this research would prove 
to apply equally to boys and girls. For this reason, and for others as well, 
Including the fact that the correlation matrix for males and the one for 
females differed significantly In some respects. It was decided to carry 
out a factor analysis separately for each sex, and In order to maintain 
comparability of results, to Include exactly the same variables In both 
analyses. 

Procedure 

Initial Steps . Since the 99-varlable consistent matrix for males had 
two 0 eigenvalues, two variables had to be eliminated from It before factor 
analysis. In order to make the matrix non-singular. Accordingly variables 
R-135 and R-138 were eliminated. To maintain parallel data for grades 9 and 
12, those variables were eliminated for both grades, thus cutting the 99 
variables to 95. The same four variables were eliminated from the matrix 
for females (although non-singular Ity In this case could have been achieved 
by eliminating a single variable) In order to have the analysis for females 
parallel the one for males. Thus both of the 99-varlable consistent matrices 
(lA and IB) were reduced to 95-varlable non-singular consistent matrices. 

Multiple correlations were then obtained for use In the diagonal. For 
this purpose each of the 95 variables was used as the dependent variable, 
with the remaining 94 as Independent variables. The resulting multiple 
correlation coefficients are shown In columns 1-2 of Tables 6-6a and 6-6b. 
(These tables also contain other data which will be explained later In the 
chapter.) The correlation matrices maintained their Internal consistency 
almost fully even after multiple R's were substituted for I's in the diagonal. 
There were a very few negative eigenvalues for each matrix (only four each 
out of a total of 95 eigenvalues each) and they were so close to 0 that 
departures could reasonably be attributed to sampling errors. (The details 
about the eigenvalues are presented In Table 6-4.) 



A principal factor analysis was then applied to the matrix^ extracting 
all 95 principal factors. The last four for each matrix were imaginary, 
of course, (as can be seen from Table 6—4) but utterly trivial, the 
largest 4 .oading for any of the eight imaginary factors (four for each of two 
matrices) being only .086t and the largest off-diagonal residual correlation 
in either matrix without use of these imaginary factors being only about 

.006. 

Number of Principal Factors Retained . In the absence of a satisfactory 
arbitrary criterion as to how many factors to retain (it will be recalled that 
the widely used procedure of retaining only factors with eigenvalues greater 
than 1 was duly considered and rejected for the present study) there is 
a considerable element of subjective judgment in the decision. In the case 
of the factor analyses under consideration the decision was based primarily 
on inspection of the distributions (after extraction of various numbers of 
common factors) of correlation residuals, which were divided into three 
kinds — (1) diagonal terms, (2) off-diagonal terms representing the residual 
of the correlation between a grade 9 variable and the correspo nding grade 12 
variable, and (3) all other off-diagonal residual terms. The greatest 
attention was paid to the last of these three categories. The first category 
(diagonal residuals) was considered of hardly any Importance since these 
residuals were not measured from "true" communalities but from fallible 
estimates of communality. In other words, they were residuals from estimates 
and approximations, not from hard empirical data. The second category of 
off-diagonal residuals (between corresponding grade 9 and grade 12 variables) 
was considered of major importance, but for reasons to be discussed later, 
did not play much of a role in the decision as to number of common factors 
to rotate. Thus the primary basis was the distribution of the off-diagonal 
residuals in the third category. Visual inspection of these data, together 
with some trial quartimax and varimax rotations of different numbers of 
factors, suggested that from the viewpoint of contributing to interpre table 
and useful rotated factors, principal factors beyond the first 17 were 
best ignored. This held for both boys and girls. The distributions of all 
three categories of, residuals after extraction of the first 17 principal 
factors are shown in Table 6-5. It will be noted that the category 3 
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residuals (off-diagonal residuals other than those between corresponding 
grade 9 and grade 12 variables) have their mean very close to zero and that 
their standard deviation is also very small* This constituted the primary 
evidence for not using principal factors beyond the 17th. 

Supplementary information used in the decision was provided by the 
canonical correlations between grade 9 variables and grade 12 variables. 

(In determining these canonicals there were 49 variables, not 47, in the set 
for each grade, since the two Information scales eliminated from the matrix 
for the factor analysis — Architecture (R-135) and Military (R-138)— were 
Included in the canonicals.) It will be recalled that in the case of both 
canonical analyses — the one based on males and the one for females— 17 of 
the 49 canonical correlations turned out to be definitely significant. This 
suggested that as an absolute minimum 17 factors should be rotated since 
the canonical analyses indicated there were at least 17 completely independent 
dimensions linking the grade 12 measures with those for grade 9. 

The possibility of additional dimensions providing linkage among 
variables within one grade and independent of variables in the other grade 
also must be recognized. This dictates the desirability of allowing for at 
least a few more common factors than the minimum number indicated above, 

17. As we shall see, a substantial number of additional common factors was 
allowed for by a technique wholly independent of the rotation of principal 
factors. This is discussed later in this chapter, under the heading 
"Extraction of Test-Specific Doublet Factors." 

A combination of all these considerations and others as well (i.e., 
hunch) led to the decision to rotate exactly 17 principal factors for males 
and the same number for females. 

Consequences of Use of Multiple R in Diagonal . It is interesting to 
note, in passing, that the proportion of the total variance that is explained 
by the common factors that are extracted by the principal factor method and 

2 

retained turns out, for most variables, to be much closer to multiple R 
than to multiple R. (It even remains true when we add the test-specific 
factors since they do not change the picture much, as far as percentage of 
variance extracted is concerned.) But this is by no means to be regarded as 

2 

an argument for starting with multiple R in the matrix diagonal Instead of 
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TABLE 6-5. Distribution of correlation residuals 

after extraction of 17 principal factors 



Res id. 

(Lower 

bound 

of 

interval) 




Off 


-diae. 


residuals 




Dias. 


resids. 


non- 


■corresp. 


1 


corresp. 


all 


M 


F 


M 


F 


1 

1 

1 


M 


F 


M 


F 


.20+ 






1 

1 

1 

1 










49 


56 


.19 






1 

1 

1 










12 


7 


.18 






1 

1 










8 


5 


.17 






1 

1 










5 


10 


.16 






1 

1 










3 


5 


.15 






1 

1 










9 


3 


.14 






1 

1 

1 










2 


2 


.13 






1 

1 










3 


2 


.12 






1 

1 










4 


3 


.11 






1 

1 














.10 






1 

1 




1 




1 






.09 






1 

1 


1 


2 


1 


2 




1 


.08 


1 




1 

1 


1 


2 


2 


2 




1 


.07 




1 


1 

I 


1 


5 


1 


6 






.06 


10 


8 


1 

1 


6 


3 


16 


11 






.05 


15 


12 


1 

1 


5 


6 


20 


18 






.04 


25 


60 


1 

1 

I 


9 


4 


34 


64 






.03 


97 


139 


1 

I 


6 


10 


103 


149 






.02 


291 


284 


1 

1 


6 


4 


297 


288 






.01 


619 


539 


1 

I 


2 


3 


621 


542 






.00 


929 


923 


1 

1 


2 


3 


931 


926 






-.01 


965 


980 


1 

1 


3 


1 


968 


981 






-.02 


780 


741 


1 

1 


2 


1 


782 


742 






-.03 


404 


397 


1 

I 


1 


1 


405 


398 






-.04 


159 


196 


1 

1 






159 


196 






-.05 


70 


88 


1 

1 






70 


88 






-.06 


27 


32 


1 

1 

1 






27 


32 






-.07 


15 


10 


i 


1 




16 


10 






-.08 


8 


4 


1 

1 

1 


1 


1 


9 


5 






-.09 




2 


1 

1 

1 








2 






-.10 


2 


2 


1 

1 

1 






2 


2 






-.11 






1 

1 

1 














-.12 






1 














-.13 


1 




r 

1 

1 






1 








No. 


4418 


4418 


1 

1 

1 

1 


47 


47 


4465 


4465 


95 


95 


Mean 


-.003 


-.003 


1 

1 

1 


.032 


.041 


-.002 


-.002 


.214 


.208 


S.D. 


.019 


.020 


1 

1 

1 

1 


.034 


.034 

1 


.019 


.020 


.221 


.212 
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with multiple R. As has already been pointed out, the chief argument for the 

2 

use of multiple R instead of multiple R is that the former produces a matrix 

' X 

that is in effect internally consistent , while the matrix resulting from the 

use of multiple R would necessarily be internally Inconsistent (unless 
values other than the observed correlations were used in it). And that 
argument still holds. The fact that the off-diagonal residuals are so very 
small even when only 17 principal factors were used as the basis (see Table 
6-5) shows that the solution fits the empirical data very well. It seems 

2 

probable that if multiple R had been used with the same number of principal 
factors retained, the off-diagonal residuals from the empirical correlation 
data would have been larger, indicating a poorer fit, and also (although 
this is not in Itself a criticism) that the proportion of total variance 
extracted would have been still lower, since most of the diagonal terms 
reproduced by the extracted factors would, as usual, have been substantially 

2 

lower than the original diagonal terms (multiple R in this case). 

Extraction of Test-Specific Doublet Factors . Now let us focus our 
attention on what we have more or less brushed aside thus far — the off- 
diagonal residuals corresponding to the diagonal elements of the inter- 
grade matrix. Examination of the distribution of these residuals, shown in 
Table 6-5 in the columns headed "Corresp.," reveals a striking phenomenon. 

Not only are almost all of them positive but they tend to be systematically 
higher than the other off-diagonal residuals. And this phenomenon is not 
unique to the 17-factor residuals. As a matter of fact, after extraction 
of just about any reasonable number of common factors the residual correla- 
tions between corresponding grade 9 and grade 12 variables tend to be 
substantially larger than the residual correlations between other pairs of 
variables. For most of the variables, as a matter of fact, these residual 
correlations between corresponding grade 9 and grade 12 variables turn out 
to be the largest off-diagonal residuals in their row, and also in their 
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TABLE 6-6a. Determination of test-specific loadings, 



and miscellaneous related statistics 

For factor analysis of consistent Matrix lA: MALES 



17 

E 





Mult 


.R 




No. of 


Gr . 


Gr . 


Gr . 


Items 


9 


12 


9 




(1) 


(2) 


(3) 



Information 1 



2 

ij 


Diag. Resid. 
(for 17 factors) 


Resid. 
’^9,12 ’^9,12 


4(esid. 

(>.2) 


i=l 


Gv < 

12 


Gr . 
9 


Gr . 
12 


Gr . 
9 


Gr . 
12 


(4) 


(5) 


(6) 


(7) (8) 


(9) 


(10) 


(11) 



«-102 


Vocabulary I 


21 


.882 


.962 


R-103 


Literature 


24 


.863 


.950 


R-104 


Music 


13 


.808 


.929 


R-105 


Social Studies 


24 


.905 


.962 


R-106 


Mathematics 


23 


.837 


.977 


R-107 


Physical Science 


18 


.872 


.954 


R-108 


Biological Science 


11 


.890 


.912 


R-109 


Scientific Attitude 


10 


.710 


.915 


R-110 


Aero. -Space 


10 


.813 


.968 


R-111 


Electricity and Electronics 


20 


.884 


.926 


R-112 


Mechanics 


19 


.843 


.939 


R-113 


Farming 


12 


.908 


.957 


R-114 


Home Economics 


21 


.802 


.941 


R-115 


Sports 


14 


.873 


.933 




Information II 








R-131 


Art 


12 


.842 


.856 


R-132 


Law 


9 


.732 


- .950 


R-133 


Health 


9 


.786 


.931 


R-134 


Engineering 


6 


.717 


.964 


R-139 


Acct. , Bus. , Sales 


10 


.802 


.956 


R-140 


Practical Knowledge 


4 


.709 


.910 


R-142 


Bible 


15 


.850 


.961 


R-145 


Hunting 


5 


.679 


.774 


R-146 


Fishing 


5 


.702 


.728 


R-147 


Outdoor Activities (other) 


9 


.744 


.934 


R-150 


Theater; Ballet 


8 


.743 


.942 


R-162 


Vocabulary II 


9 


.888 


.899 


R-212 


Memory for Words 


24 


.730 


.866 


R-220 


Disguised Words 


30 


.783 


.921 




English 








R-231 


Spelling 


16 


.756 


.896 


R-232 


Capitalization 


33 


.940 


.945 


R-233 


Punctuation 


27 


.858 


.919 


R-234 


English Usage 


25 


.705 


.780 


R-235 


Effective Expression 


12 


.651 


.764 


R-240 


Word Functions 


24 


.794 


.945 


R-250 


Reading Comprehension 


48 


.890 


.983 


R-260 


Creativity 


20 


.881 


. .970 


R-270 


Mechanical Reasoning 


20 


.837 


.947 


R-281 


Vis. in 2 Dimensions 


24 


.816 


.980 


R-282 


Vis. in 3 Dimensions 


16 


.794 


.815 


R-290 


Abstract Reasoning 


15 


.752 


.787 




Mathematics 








R-311 


I. Arithmetic Reasoning 


16 


.796 


.894 


R-312 


II. Intro, h.s. Math. 


24 


.858 


.961 


R-333 


III. Adv. h.s. Math. 


14 


.460 


.930 


F-410 


Arithmetic Computation 


72 


.729 


.905 


F-420 


Table Reading 


72 


.632 


.897 


F-430 


Clerical Checking 


74 


.632 


.922 


F-440 


Object Inspection 


40 


.675 


.764 


P*801 


Socioeconomic Index 


9 


.757 








o 

I ERIC 






.761 

.684 

.605 

.741 



.689 

.721 

.621 

.476 



.604 

.703 

.661 



.657 

.612 

.702 



.638 

.495 

.557 

.431 



.569 

.489 

.691 



.456 

.482 

.520 



.811 

.794 

.696 

.788 



.853 

.826 

.675 

.644 



.717 

.767 

.726 



.731 

.807 

.777 



.653 

.647 

.619 

.571 



.694 

.658 

.802 



.595 

.561 

.631 



.550 

.736 



.661 

.730 



.539 

.586 



.744 

.731 



.565 

.679 

.636 

.517 

.439 



.696 

.702 

.728 

.584 

.538 



.574 

.758 



.707 

.798 



.544 

.686 

.545 

.602 

.534 



.646 

.710 

.669 

.630 

.567 



.648 

.687 

.134 



.711 

.825 

.741 



.463 

.431 

.442 

.482 



.631 

.698 

.630 

.496 



.379 






120 


.151 


.738 


.026 




.761 


.811 


180 


.156 


.705 


.045 


.212 


.729 


.839 


203 


.234 


.710 


.097 


.311 


.702 


.793 


164 


.174 


.738 


.062 


.249 


.803 


.850 


148 


.124 


.711 


-.009 




.689 


.853 


151 


.128 


.742 


.035 




.721 


.826 


269 


.237 


.635 


.053 


.230 


.674 


.728 


234 


.270 


.544 


.064 


.253 


.540 


.708 


208 


.252 


.662 


.059 


.243 


.663 


.776 


181 


.159 


.701 


.019 




.703 


.767 


182 


.214 


.643 


.044 


.210 


.705 


.770 


251 


.226 


.620 


.026 




.657 


.731 


190 


.134 


.557 


-.075 




.612 


.807 


170 


.157 


.699 


.022 




.702 


.777 



.204 


.203 


.635 


.065 


.255 


.703 


.718 


.237 


.303 


.526 


.057 


.239 


.552 


.704 


.229 


.312 


.513 


.063 


.251 


.620 


.682 


.286 


.393 


.408 


.041 


.202 


.472 


.612 


.234 


.262 


.465 


-.022 




.569 


.694 


.220 


.251 


.478 


.035 




.489 


.658 


.160 


.159 


.731 


.038 




.691 


.802 


.223 


.180 


.520 


.026 




.456 


.595 


.220 


.16? 


.531 


.046 


.214 


.528 


.607 


.224 


.303 


.534 


.074 


.272 


.594 


.705 


.193 


.281 


.581 


.044 


.210 


.594 


.705 


.152 


.169 


.641 


.029 




.736 


.730 


.190 


.122 


.513 


-.070 




.539 


.744 


.197 


.190 


.585 


.047 


.217 


.633 


.778 



190 


.200 


.638 


.081 


.285 


.646 


.777 


261 


.243 


.381 


-.011 




.679 


.702 


222 


.191 


.657 


.058 


.241 


.694 


.786 


187 


.196 


.522 


.047 


.217 


.564 


.631 


212 


.226 


.454 


.034 




.439 


.538 


220 


.238 


.611 


.046 


.214 


.620 


.753 


132 


.185 


.699 


.048 


.219 


.806 


.846 


337 


.324 


.541 


.067 


.259 


.611 


.713 


151 


.237 


.655 


.036 




.686 


.710 


271 


.310 


.479 


.002 




.545 


.669 


192 


.184 


.599 


.055 


.235 


.657 


.685 


217 


.220 


.567 


.067 


.259 


.601 


.634 



148 


.183 


.651 


.030 


.648 


.711 


171 


.136 


.691 


-.001 


.687 


.825 


326 


.189 


.226 


-.005 


.134 


.741 


266 


.274 


.478 


.011 


.463 


.631 


201 


.199 


.151 


.024 


.431 


.698 


190 


.292 


.266 


.006 


.442 


.630 


194 


.267 


.275 


-.012 


.482 


.496 



.377 .379 




R-102 

R-103 

R-lOA 

R-105 



R-106 

R-107 

R-108 

R-109 



R-110 

R-111 

R-112 



R-113 

R-114 

R-115 



R-131 

R-132 

R-133 

R-13A 



R-139 

R-IAO 

R-1A2 



R-1A5 

R-1A6 

R-1A7 



R-150 

R-162 



R-212 

R-220 



R-231 

R-232 

R-233 

R-23A 

R-235 



R-240 

R-250 



R-260 

R-270 

R-281 

R-282 

R-290 



R-311 

R-312 

R-J33 



F-410 

F-420 

F-430 

F-440 



ERIC 
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TABLE 6-6b. Determination of test-specific loadlngSi 
and miscellaneous related statistics 



Information I 



Vocabulary I 

Literature 

Music 

Social Studies 



Mathematics 
Physical Science 
Biological Science 
Scientific Attitude 



Farming 

Home Economics 
Sports 



Information II 



Art 

Law 

Health 

Engineering 



Acct.y Bus., Sales 
Practic'^1 Knowledge 
Bible 



Hunting 

Fishing 

Outdoor Activities (other) 



Theater; Ballet 
Vocabulary II 



Memory for Words 
Disguised Words 



English 



Spelling 
Capitalization 
Punctuation 
English Usage 
Effective Expression 



Word Functions 
Reading Comprehension 



Creativity 

Mechanical Reasoning 
Vis. in 2 Dimensions 
Vis. in 3 Dimensions 
Abstract Reasoning 



Mathematics 



I • Arithmetic Reasoning 
II. Intro, h.s. Math. 
III. Adv. h.s. Math. 



Arithmetic Computation 
Table Reading 
Clerical Checking 
Object Inspection 



P*801 Socioeconomic Index 



for factor analysis or consistent Matrix IBt 



No. of 
Items 



Aero.-bpace 

Electricity and Electronics 
Mechanics 



17 



40 



Mult.R 






Gr. 

9 



Gr. 

12 






ij 



Gr. 

9 



Gr. 

12 



Diag. Resld. 
(for 17 factors) 
Gr. Gr. 



’^ 9,12 



Resld. 
r^ 



(1) (2) (3) (4) 



9 

(5) 



12 

( 6 ) 



(7) 



^ 9,12 



ViResid. 
«b , 



Eb? 



i 

(>. 2 ) 






Gr. 

9 



( 8 ) 



Gr. 

12 



.650 



.443 



.207 



(9) (10) (11) 



21 


, .853 


.967 


.716 


.802 


.138 


.164 


.757 


.034 




.716 


.802 


24 


.808 


.937 


.628 


.768 


.180 


.169 


.714 


.050 


.224 


.678 


.818 


13 


.819 


.937 


.620 


.692 


.199 


.246 


,737 


.109 


,330 


.729 


.801 


24 


.894 


.927 


.722 


.769 


.173 


.158 


.792 


.073 


.270 


.795 


.842 


23 


.786 


.955 


.609 


.832 


.177 


.122 


.684 


.005 




.609 


.832 


18 


.872 


.887 


.641 


.790 


.232 


.098 


.,707 


.028 




. 641 


.790 


11 


.777 


.851 


.529 


.604 


.248 


.246 


.617 


.082 


.286 


.611 


.686 


10 


.683 


.832 


.450 


.591 


.233 


.241 


.515 


.027 




.450 


.591 


10 


.649 


.883 


.382 


.655 


.267 


.228 


.473 


.017 




.382 

COO 


.655 


20 


.766 


.765 


.533 


.572 


.233 


.193 


.457 


.001 




.533 


• J/Z 


19 


.708 


.933 


.500 


.692 


.207 


.242 


.575 


.046 


.214 


.546 


.738 


12 


.789 


.851 


.584 


.653 


.205 


.198 


.689 


.094 


.307 


.678 


.747 


21 


.778 


.890 


.591 


.667 


.187 


.222 


.643 


.070 


.265 


.661 


.737 


14 


.760 


.763 


.506 


.552 


.254 


.211 


.607 


.093 


.305 


.599 


.645 


12 


.805 


.904 


.623 


.668 


.182 


.236 


.667 


.070 


.265 


.693 


.738 


9 


.626 


.892 


.375 


.598 


.251 


.295 


.444 


.033 




.375 


.598 


9 


.750 


.876 


.535 


.659 


.215 


.217 


.546 


.048 


.219 


.583 


.707 


6 


.587 


.876 


.353 


.616 


.235 


.261 


.412 


.038 




.353 


.616 


10 


.725 


.884 


.491 


.683 


.233 


.201 


.519 


.035 




.491 


.683 


4 


.698 


.684 


.438 


.406 


.260 


.278 


.429 


.067 


.259 


,505 


.473 


15 


.843 


.922 


.722 


.835 


.120 


.087 


.762 


.021 




.722 


.835 


5 


.369 


.689 


.124 


.477 


.246 


.212 


.239 


.017 




.124 


.477 


5 


.350 


.560 


.106 


.363 


.244 


.197 


.238 


.070 


.265 


.176 


.433 


9 


.702 


.856 


.467 


.572 


.235 


.284 


.512 


.068 


.261 


.535 


.640 


8 


.826 


.963 


.572 


.703 


.254 


.260 


.632 


.072 


.268 


.644 


.775 


9 


.831 


.929 


.656 


.679 


.175 


.250 


.620 


.039 




.656 


.679 


24 


.850 


.935 


.607 


.814 


.243 


.122 


.553 


-.075 




.607 


.814 


30 


.811 


.905 


.606 


.682 


.205 


.223 


.610 


.051 


.226 


.657 


.733 


16 


.810 


.907 


.621 


.682 


.189 


.225 


.585 


.035 




.621 


.682 


33 


.936 


.791 


.701 


.599 


.235 


.192 


.309 


-.029 




.701 


.599 


27 


.844 


.913 


.681 


.755 


.162 


.157 


.693 


.059 


.243 


.740 


.814 


25 


.695 


.811 


.461 


.639 


.234 


.172 


.492 


.055 


.235 


.516 


.694 


12 


.662 


.778 


.423 


.576 


.240 


.202 


.481 


.068 


.261 


.491 


.644 


24 


.785 


.845 


.604 


.671 


.181 


.174 


.661 


.048 


.219 


.652 


.719 


48 


.931 


.916 


.773 


.770 


.159 


.146 


.764 


.031 




.773 


.770 


20 


.708 


.864 


.475 


.612 


.233 


.252 


.539 


.056 


.237 


.531 


.668 


20 


.786 


.928 


.579 


.693 


.207 


.235 


.635 


.039 




.579 


.693 


24 


.688 


.725 


.484 


.563 


.204 


.162 


.565 


.085 


.292 


.569 


.648 


16 


.727 


.864 


.524 


.648 


.202 


.217 


.586 


.038 




.524 


.648 


15 


.746 


.843 


.552 


.602 


.195 


.241 


.600 


.053 


.230 


.605 


.655 


16 


.820 


.853 


.647 


.683 


.173 


.170 


.684 


.049 


.221 


.696 


.732 


24 


.810 


.954 


.664 


.821 


.147 


.133 


.675 


-.001 




. fab4 


. 821 


14 


.346 


.917 


.063 


.717 


.283 


.200 


. 150 


-.018 




.063 


.717 


72 


.745 


.835 


.441 


.638 


.305 


.197 


.483 


.022 




.441 


.638 


72 


.534 


.783 


.357 


.604 


.177 


.179 


.230 


.013 




.357 


.604 


74 


.612 


.754 


.439 


.509 


.173 


.245 


.283 


.004 




.439 


.509 


40 


.677 


.872 


.494 


.635 


.183 


.237 


.407 


.036 




.494 


.635 



.443 
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column, of the residual matrix, and if they are large enough to be non- 
trivial they are usually the only non-trivial residuals in that row or 
column . 

These considerations, together with a priori expectations that linkages 
explaining variance unique to a particular test but common to the grade 9 
and grade 12 scores obtained with this test would manifest themselves, 
suggested that each of these non-trivial residuals between corresponding 
grade 9 and grade 12 variables can legitimately be considered the basis of 
a doublet factor — a factor entering into only the two variables involved. 

In other words what we seem to have is a situation in which subjective 
judgment should be allowed to modify the principal factor pattern through 
the addition of some of the "test-specific^" factors revealed by the inspec- 
tion of residuals. This means the addition of new factors, orthogonal to 
the first 17 principal factors and to each other, but not themselves 
principal factors (and in most cases probably not even obtainable from the 
full set of principal factors by rotation). 

Loadings for each of these new factors were defined as being 0 for all 

variables other than the two (grade 9 score and grade 12 score) for the test 

2 

they referred to. For these two variables the loadings were indeterminate , 
the only restriction imposed being that their product had to equal the 
residual of their correlation. In the absence of any specific hypothesis 
to the contrary, equal loadings were assigned to the ninth-grade score and 
the twelfth-grade score (these loadings being equal, of course, to the square 
root of the residual). 

Table 6-6a shows some data relevant to the test-specific factors for 
males and Table 6-6b shows comparable data for the females. Column 7 in 
each of these tables shows the original correlation between corresponding 
grade 9 and grade 12 scores. (These correlations are extracted from 
Tables 6-la and 6-lb.) Column 8 shows the corresponding residuals after 



^The term "test-specific" is used here to signify that these new factors 
represent reliable variance that is specific to the particular test and 
that they thus would be true specific factors if the matrix factor-analyzed 
involved only a single administration of the battery. Technically they are 
"common factors" but they have this status only because the tests were 
administered twice. 

^This indeterminacy is a general characteristic of loadings on doublets 
(common factors entering into only two variables). 
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TABLE 6-7. Final distribution of correlation residuals, 
after extraction of 17 principal factors 
and 23 test-specific factors 



Resid. 

(Lower 

bound 

of 

interval) 




Of f-diae. 


residuals 




Diae. 


resids. 


non- 


•corresp. | 


corresp. | 




all 


M 


F 


M 


1 

F 


M 


1 

Fl 


M 


F 


.20+ 








r 

1 

1 

1 

1 






49 


56 


.19 








1 

1 






12 


7 


.18 








1 

1 






8 


5 


.17 








1 

1 






5 


10 


.16 








1 

1 






3 


5 


.15 








1 

1 






9 


3 


.14 








1 

1 






2 


2 


.13 








1 

1 






3 


2 


.12 








1 

1 






4 


3 


.11 








1 

1 










.10 








1 

1 










.09 








1 

1 








1 


.08 


1 






1 

1 


1 






1 


.07 




1 




1 

1 




1 






.06 


10 


8 




1 

1 


10 


8 






.05 


15 


12 




1 

1 


15 


12 






.04 


25 


60 




1 

1 


25 


60 






.C3 


97 


139 


6 


10 1 


103 


149 






.02 


291 


284 


6 


4 1 


297 


288 






.01 


619 


539 


2 


3 1 


621 


542 






.00 


929 


923 


14 


15 1 


943 


938 






-.01 


965 


980 


14 


12 1 


979 


992 






-.02 


780 


741 


2 


1 1 


782 


742 






-.03 


404 


397 


1 


1 1 


405 


398 






-.04 


159 


196 




1 

1 


159 


196 






-.05 


70 


88 




1 

1 


70 


88 






-.06 


27 


32 




1 

1 


27 


32 






-.07 


15 


10 


1 


1 

1 


16 


10 






-.08 


8 


4 


1 


1 1 


9 


5 






-.09 




2 




1 

1 




2 






-.10 


2 


2 




1 


2 


2 






-.11 








1 

1 










-.12 








1 

1 










-.13 


1 






1 

1 

1 


1 








No. 


4418 


4418 


47 


47 1 
1 


4465 


4465 


95 


95 


Mean 


-.003 


-.003 


.004 


1 

.008 1 


-.003 


-.002 


.214 


.208 


S.D. 


.019 


.020 


.022 


.020 1 
1 


.019 


.020 


.221 


.212 



< 
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extraction of 17 principal factors. Columns 3-A show the computed communality 
reproduced by these same 17 principal factors. 

It was decided to extract inter-grade doublet factors only for those 
tests for which the inter-grade residual correlation was at least +.0A, so 
that its square root, used as the loading, would be at least .20. On this 
basis, 23 test-specific doublet factors were added for the males, and (strictly 
by coincidence) exactly the same number for the females. The loadings on 
these test-specific factors are shown in Tables 6-6a and 6-6b, in column 9. 

The diagonal residuals based on the 17 principal factors are shown in 
columns 5-6. These residuals are diminished by the amounts shown in column 8, 
when the test-specific factors are taken into account. 

The inter-grade residuals corresponding to the added doublet factors 
drop automatically to 0, of course, and the corresponding reproduced com- 
munalities are raised substantially. Columns 10-11 show these new communalities 
after inclusion of the test-specific factors. These are the final computed 
communalities. The revised distribution of residuals is shown in Table 6-7. 

It is quite apparent from a comparison of this table with Table 6-5 
that extraction of the test-specific factors improves the factor solution 
materially. The mean of the off-diagonal correlation residuals for correspond- 
ing grade 9 and grade 12 variables is no longer markedly further from 0 
than the mean for residuals of non-corresponding variables, nor is the 
standard deviation of the residuals any longer nearly twice as large for 
corresponding variables as for non -cor responding ones. Extraction of the 
test-specific factors reduces the former standard deviation to about the 
same size as the latter. 

It is important to recognize that the doublet factors, because of the 
way they were generated, are necessarily orthogonal to all the other factors — 
in other words uncorrelated with them — and that they are in every sense just 
as "legitimate'* as any of the other factors even though not derived from a 
rotation of principal factors. 

In addition to the 23 doublets, it will be seen when the results of the 
rotation of the first 17 principal factors are presented that some of these 
rotated factors also turn out to be very much like doublets — in other words 
to have substantial loadings on only two variables — the grade 9 and grade 12 
scores for the same test (in every case, of course, a test that is not one 
of the 23 having a doublet factor). 
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Th6 6xist6nce of all thosa doublat and naar— doublet factors has important 
psychomatric implications — but mora about that latar. 



Rotation of Principal Factors . Naithar quart imax nor normal varimax 

gava complataly claar— cut factor patterns for which direct interpretation 
was immediately apparent. The quartimax solution failed to meet the criterion 
of positive manifold; it produced several substantial bipolar factors. The 
varimax procedure eliminated this difficulty but did not produce a solution 
that had a clear interpretation. This was a situation in which it seemed 
desirable to resort to subjective rotations, which accordingly were undertaken, 
using the normal varimax pattern as a starting point. Orthogonality was 
maintained in the rotations. 

Four pairs of varimax factors for males were rotated, and four pairs 
for females (a pair at a time). 

An example of one such orthogonal rotation — the rotation of varimax 
factors Vj^Q and for males to produce final factors and F^— — is shown in 

Figure 6-1. In the graph used operationally all variables were plotted for 
which the loading on at least one of the two varimax factors was .14 or 
more. In the interests of visual clarity, however. Figure 6-1 has been 
simplified, to show only those tests with sizable loadings on at least one 
of the two varimax factors and My The ten pairs of points shown in it 

represent the grade 9 and grade 12 test variables for the following: R— 220, 

®^”231, R— 232, R— 233, R— 234, R— 235, P^- 240, R— 250, R— 260, R— 311. All except 

the last two of these are direct measures of language skills. These ten 
variables are all the ones for which one or both of the two points (grade 9 
and grade 12) are at a distance of at least .30 from the origin. Socioeconomic 



index (P*801) is also plotted. It will be noted that the high loadings 



are on variables measuring language skills (reading, English, etc.) in grade 12 
while variables measuring the same skills in grade 9 have low loadings. 



On factor on the other hand, the grade 9 measures of language skills 



have substantially higher loadings than the same measures for grade 12. 

A factor which plays a major role in language skills in grade 9, only to 
shrink in importance by the time grade 12 is reached and be largely replaced 
by a brand new factor, is not a helpful explanatory concept. A 27‘*-rotation 
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figure 6-1. Subjective Rotation of Two Varimax Factors (V^^q and V^) 
(Based on factor analysis of Matrix lAt Males) 
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TABLE 6-8, Factor loadings on a pair of varlmax factorSi and on the same pair after subjective rotation® 
(In factor analysis of Matrix lA: Males) 



FACTOR LOADINGS 



Varlmax 


factors 




Subjectively rotated 
factors 




'^10 


''s 






^6 




Gr. Gr. 


Gr. 


Gr, 


Gr. Gr. 


Gr. 


Gr. 


9 12 


9 


12 


9 12 


9 


12 





Information I 


















R-102 


Vocabulary I 


.136 


.068 


.136 


.148 


.183 


.128 


.060 


. .101 


R-103 


Literature 


.085 


-.007 


.135 


.203 


.137 


.086 


.081 


.184 


R-104 


Music 


.119 


.102 


.078 


.117 


.142 


.144 


.015 


.058 


R-105 


Social Studies 


.019 


-.042 


.120 


.168 


,072 


.039 


.098 


.169 


R-106 


Mathematics 


.087 


-.045 


.014 


.100 


.084 


.005 


-.027 


.109 


R-107 


Physical Science 


.014 


-.025 


.111 


,102 


.063 


.024 


.092 


.102 


R-108 


Biological Science 


.027 


-.058 


.143 


.172 


.089 


.026 


.115 


.180 


R-109 


Scientific Attitude 


.147 


.079 


.164 


.143 


.206 


.135 


.079 


.092 


R-110 


Aeronautics and Space 


.088 


.021 


.038 


.044 


.095 


.039 


-.006 


.029 


R-lll 


Electricity and Electronics 


.065 


.037 


-.015 


-.010 


.051 


.028 


-.042 


-.026 


R-112 


Mechanics 


.146 


.093 


.083 


.061 


.168 


.110 


.008 


.012 


R-113 


Farming 


.089 


.062 


.112 


.156 


.130 


.126 


.059 


.111 


R-114 


Home Economics 


.036 


.012 


.048 


.080 


.054 


.047 


.027 


.066 


R-115 


Sports 


.076 


.028 


.057 


.063 


.094 


.053 


.016 


.044 




Information II 


















R-131 


Art 


.067 


.094 


.159 


.175 


.132 


.163 


.112 


.113 


R-132 


Law 


-.006 


-.004 


.068 


.100 


.025 


.042 ' 


.063 


.091 


R-133 


Health 


.051 


.096 


.134 


.143 


.106 


.150 


.096 


.084 


R-134 


Engineering 


.054 


.134 


.083 


-.026 


.085 


.108 


.049 


-.084 


R-139 


Acctei BuSeg Sales 


-.062 


.024 


.045 


.029 


-.035 


.035 


.068 


.015 


R-140 


Practical Knowledge 


-.008 


.009 


.161 


.130 


.066 


.067 


.147 


.111 


R-142 


Bible 


.051 


.139 


.109 


.116 


.094 


.177 


.074 


.040 


R-145 


Hunting 


-.000 


.027 


.035 


-.039 


.015 


.006 


.031 


-.047 


R-146 


Fishing 


-.009 


.060 


.049 


-.002 


.014 


.052 


.048 


-.029 


R-147 


Outdoor Activities (other) 


.053 


.196 


o087 


.052 


.087 


.199 


.054 


-.043 


R-150 


Theater; Ballet 


.114 


.182 


.114 


.139 


.153 


.225 


.050 


.041 


R-162 


Vocabulary 11 


.042 


.108 


.128 


.170 


.096 


.173 


.095 


.102 


R-212 


Memory for Words 


.136 


.029 


.045 


.235 


.142 


.132 


-.022 


.196 


R-220 


Disguised Words 


.302 


.142 


.191 


.463 


.356 


.336 


.033 


.348 




English 


















R-231 


Spelling 


.343 


.190 


.209 


.488 


.400 


.390 


.030 


.349 


R-232 


Capitalization 


.465 


-.009 


.275 


.737 


.539 


.327 


.034 


.661 


R-233 


Punctuation 


.334 


.138 


.217 


.520 


.396 


.359 


.042 


.401 


R-234 


English Usage 


.437 


.253 


.220 


.505 


.490 


.455 


-.003 


.335 


R-235 


Effective Expression 


.392 


.281 


.166 


.475 


.424 


.466 


-.030 


.296 


R-240 


Word Functions 


.207 


-.000 


.124 


.363 


.240 


.164 


.016 


.324 


R-250 


Reading Comprehension 


.232 


.035 


.176 


.464 


.286 


.242 


.052 


.398 


R-260 


Creativity 


.239 


.054 


.088 


.352 


.253 


.208 


-.030 


.290 


R-270 


Mechanical Reasoning 


.184 


.010 


.021 


.258 


.173 


.126 


-.064 


.226 


R-281 


Visualization in 2 Dimensions 


.043 


-.060 


-.011 


.079 


.034 


-.017 


".030 


.098 


R-282 


Visualization in 3 Dimensions 


.064 


-.046 


-.050 


.159 


.035 


.032 


-.074 


.162 


R-290 


Abstract Reasoning 


.169 


.047 


.053 


.236 


.175 


.149 


-.030 


.189 




Mathematics 


















R-311 


!• Arithmetic Reasoning 


.156 


.075 


.075 


.320 


.173 


.212 


-.004 


.251 


R-312 


II. Intro, h.s. Math. 


.150 


-.009 


.073 


.277 


.167 


.118 


-.003 


.250 


R-333 


III. Adv« h.s. Math. 


.037 


-.033 


-.058 


.173 


.006 


.049 


-.069 


.169 


F-410 


Arithmetic Computation 


.133 


.044 


.047 


.258 


.140 


.156 


-.019 


.209 


F-420 


Table Reading 


.028 


.059 


.098 


-.021 


.069 


.043 


.074 


-.045 


F-430 


Clerical Checking 


.088 


-.054 


.117 


.254 


.131 


.067 


.064 


.251 


F-440 


Object Inspection 


-.002 


.022 


-.029 


.079 


-.014 


.056 


-.025 


.060 


P*80l 


Socioeconomic Index 


.066 




.028 




.072 




-.006 






Sum of squares 


1. 


79 


3. 


80 


3. 


37 


2. 


21 




Sum of squares for factor pair 




5. 


59 






5. 


58 





*See Figure 6-1. 
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of the axes, as shown in Figure 6-1, greatly improves the picture. One of 
the two nev 7 factors produced, F^, has about equal loadings on corresponding 

grade 9 and grade 12 variables. And the other new factor, Fg, has high 

loadings for grade 12 on the language skills variables and essentially zero 
loadings for grade 9 on the same variables; it also has essentially zero 
loadings for both grades on other tests. The complete set of pre-rotation 
and post-rotation loadings for the factors involved in this particular 
rotation is shown in Table 6-8. (After the angle of rotation was decided 
upon on the basis of inspection of the graph, the computer was used to deter- 
mine the new loadings.) 

The eight rotations performed (four for males, four for females) were 
all by significant amounts that resulted in important changes in the pattern 
of factor loadings. The possible range of angle of rotation, in terms of 
absolute amount, is from 0® to 45®, with 45® representing maximum change in 
factor pattern, and 0® (or 90®) no change. Bearing this in mind, it is clear 
that the eight actual rotations, which ranged in magnitude from 16® to 32®, 
had sizable effects on the final factor pattern. 

One major effect, by no means accidental, was to make the factor solu- 
tions for the two sexes more alike. The varimax solutions differed sub- 
stantially, and it was quite clear that much of the difference was unnecessary 
and misleading, since it could be easily eliminated by a few simple rotations. 

Final Set of Factors 

The final sets of factors, for both males and females, are summarized 
in Table 6-9 and the detailed factor patterns are presented in Table 6-10. 
Table 6-9 indicates the nature of each factor, its source (i.e., varimax, 
test-specific, or subjectively determined rotation), and the proportion of 
variance it accounts for, and shows the general similarity between the factors 
for males and the ones for females. (Table 6-11 concentrates on this latter 
point, showing exactly how many factors of each kind correspond for the two 
sexes.) For each factor. Table 6-9 also shows a factor number and a 
mnemonic label (of not more than five characters), for convenience in 
presentation and discussion of the results. 
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The sum of squares of factor loadings is shown in Table 6-9 for each 
factor (under the heading Zb^) , and also in Table 6-10. In Table 6-12 

these sums of squares are summarized in terms of category of common factor . 

It is apparent from this table that most of the more important factors are 
concentrated in the S-factor category (subjectively rotated factors). The 
extracted common factors account for about 78 percent of trace, of which, 
as shown in Table 6-12, almost all is from the V-f actor and S-factor categories. 
The common factors also account for roughly 65 percent of the total variance, 
as shown in the same table, and a considerably larger proportion, of course, 
of the total reliable variance. 

COMPARISON OF FACTOR PATTERNS FOR MALES AND FEMALES 

In general, and particularly as far as the more important factors are 
concerned, there is an overall similarity between the patterns for males and 
females. One major difference is that factor (English) for the males is 

split into two independent factors for females — both of them in the area, 
of English. Other conspicuous differences are (1) that the A-INF factor, 
representing change in amount of general information relative to the, group 
during the three-year interval, shows up for boys but not for girls, 

(2) that the MATH factor accounts for far more variance for the boys than 
for the girls, and (3) that a small factor, COMP, representing an aspect 
of arithmetic computation ability, also shows up for the boys but not for 
the girls. There are a few other differences but most of them either are 
very trivial or else have obvious explanations based on known sex differences 

in interests and behavior patterns. 

The general similarity between the factor patterns for the two sexes 
can perhaps be regarded as a sort of "validity generalization, providing 
evidence that the factor solution is a defensible one. 

A GENERAL FACTOR 

Verbal Factor (VERBL) . The common factor whose mnemonic is VERBL 
accounts for about one-fifth of the total battery variance and about one- 
third of the common variance (as may be seen from the bottom row of Table 6-13). 
Of all the common factors yielded by the factor analysis, this one is the 
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closest to a general factor, and the closest to what is commonly called 
"general verbal intelligence" or "scholastic aptitude" or "academic aptitude." 

This factor is closely related to measures of general information. 

Most of the tests which have high loadings in it are scales of the Informa- 
tion Test. Among the higher loadings are those with the vocabulary measures. 
Reading ability (R-250) also has very substantial loadings although not 
quite as high as vocabulary. Information in the humanities (literature, 
music, art, etc.) has higher loadings on this factor than does information 
in the technical and scientific areas (physical science, biological science, 
mathematics, electronics, etc.). 

Interestingly enough, it is the only one of the factors that has a 
high correlation with socioeconomic index (P*801). This is true for both 
sexes, although for the boys the second common factor, MATH, also has a 
sizable correlation with socioeconomic index. As may be seen from the P*801 
row in Table 6-13, of the variance in socioeconomic index accounted for by 
common factors, about half is attributable to VERBL in the case of the 
males, and nearly three-fourths in the case of the females. Probably not 
much significance should be attached to this difference in proportions for 
the two sexes since there is no way of being certain that the general factors 
are exactly the same for the two groups. (In other words instead of the 
difference between the sexes in proportion of common socioeconomic variance 
due to VERBL representing a real difference between groups it may merely 
represent a difference in the factors describing them.) There is probably 
no definitive way of resolving this ambiguity. 

Again going back to the P*801 row in Table 6-13, we see that variance 
in socioeconomic index "explains" about one-fifth of the variance in VERBL 
for the males and one-third for the females. Conversely, it is possible to 
regard variance in VERBL as "explaining" about one-fifth of the socio- 
economic variance for males, and one-third for females. Which comes first 
in the explanation depends largely on the explainer's point of view. The 
present explainer happens to favor a middle-of-the-road viewpoint. The cause- 
and-effect relationships explaining the correlation between VERBL and socio- 
j j economic index are undoubtedly complex and almost certainly operate reciprocally. 

In other words each has an effect on the other and each is at the same time 
affected by the other. This would help explain the high loadings that most 
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TABLE 6-13. Comparison of grade 9 and grade 12 test variables and socioeconomic index 
in regard to variance accounted for by general factor 
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of the information scales have on VERBL. Boys and girls in the moderate- 
to-high socioeconomic bracket not only tend to have better verbal ability 
than those from a deprived background by the time they reach high school, 
but they are also somewhat more likely to be in the kind of environment that 
makes information available to them (via reading matter, conversation, parental 
encouragement, social contacts, and general milieu) that they can acquire 
and retain if they have the ability to do so and sufficient Interest to 
motivate them. 

SOME IMFORTAET GROUP FACTORS 

Mathematics Factor (MATH) . This factor shows substantially higher 
loadings throughout for males than for females. But otherwise the patterns 
of loadings are fairly similar. For both sexes the factor has its highest 
loadings on Mathematics Information (R-106), Math I (R-311), Math II (R-312), 
and at least in grade 12, Math III (R-333) . Math III was designed for grades 
above the ninth, and therefore is almost nonfunctioning for most ninth— grade 
students, because of the fact that it tests mastery of skills and concepts 
they have never encountered. 

Other variables with sizable loadings on MATH are Physical Science 
Information (R-107), Word Functions in Sentences (R-240), which for both 
boys and girls has the highest loading on MATH of any nonmathematlcal test. 
Punctuation (R-233), Mechanical Reasoning (R-270), and Abstract Reasoning 
(R-290). In regard to the loading of Physical Science Information on MATH, 
the relation between mathematical ability and ability in the science area Is 
generally recognized. As for Mechanical Reasoning and Abstract Reasoning, 
both of these tests have a substantial element of reasoning, as their names 
imply. This Is apparently their link with the MATH factor. Somewhat less 
obviously. Word Functions In Sentences and Punctuation, both of which mea- 
sure skills In the language area, also Involve substantial elements of 
reasoning. This Is not a mere artifact arising out of the nature of the tests. 
It would appear that the kind of special ability that is needed in mathematics 
Is also helpful In the kind of comprehension of grammar principles that is 
required for the Word Functions in Sentences test. Perhaps this should not 
surprise us. In a certain sense, formal grammar is, after all, an exercise 
in logic. The ability to reason, which is obviously of major Importance in 
mastery of mathematical skills, is also Involved in the ability to punctuate 
properly. 
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Spatial Factor (SPACE ) . This factor, representing the ability to 
manipulate figures mentally in two- or three-dimensional space, has its 
highest loadings in Visualization in Three Dimensions (R-282), Visualization 
in Two Dimensions (R-281), Mechanical Reasoning (R-270), and Abstract 
Reasoning (R-290) . It also has sizable loadings on Creativity (R-260) and 
on Object Inspection (F-440); and for males but not for females on the 
technical information tests; Mechanical Information (R-112), Electrical 
and Electronic Information (R-111), and Aerospace Information (R-110) — 
in grade 12 especially. It is not surprising that the SPACE factor does 
not load on these technical information tests in the case of the girls, 
whose information in these areas is typically so scanty that the tests are 
extremely difficult for them. However the SPACE factor does load on Math I 
(R-311) and Math II (R-312) for the girls but not for the boys. 

English Factor (ENGL , or ENG-A and ENG-B) . Factor F^ (English ability) 

for the boys splits, rather surprisingly, into two distinct and independent 
English factors, F^^ (ENG-A) and F^^ (ENG-B), for the girls. All these 

factors have high loadings on some or all of the English subtests (R-131 
through R-135), which measure mastery of various formal aspects of English 
communication (i.e., punctuation, capitalization, spelling, English usage, 
etc.), in other words the use of English to express oneself in writing or 
speaking. The loadings on measures of compr ehen s ion of the English language 
as used by others (e.g., the Reading Comprehension Test, R-250) are somewhat 
lower, though still substantial. Other variables with sizable loadings are 
Word Functions (R-240) , which is closely related to knowledge of grammatical 
concepts or ability to learn them, and Disguised Words (R-220). Arithmetic 
Reasoning (Math I, R-311), which seems to have a sizable verbal component, 
particularly for the girls, is another test that shows a loading on an 
English factor. The grade 12 loadings for most variables are very similar 
to the grade 9 loadings, suggesting that this factor represents the level of 
mastery reached as of grade 9, and that it is independent of anything that 
happens during the high school years. This doesn’t mean, of course, that 
scores on the English tests are unaffected during the period in high school. 
Quite the contrary! But to see what these effects are and how they operate 
we have to look to factors other than F^ (ENGL); for instance to factor F^ 



(A-ENG) . 



Technical Information Factor (TECH ) , This factor has its highest 



loadings on the measures of information in electricity and electronics, 
mechanics,' aeronautics and space, and physical science (R-111, R-112, R-110, 
R-107). It also has sizable loadings on Mechanical Reasoning (R-270), 
particularly for the girls. 

FACTORS MEASURING CHANGE 

Factors and Fy are ’’change components" of the test variables. These 

factors are particularly interesting because they probably would not have 
shown up in any kind of factor-analytic study that didn’t involve testing 
at at least two periods several years apart. And if by some strange quirk 
these factors had shown up in a factor analysis based on a single testing 
(e.g., during grade 12) what they represented would almost certainly have 
gone unrecognized since adequate data for interpreting them would have been 
lacking. 

Gain in English Skills (A-ENG) . Factor F^ is probably a measure of 

gain in English skills. The factor is clearly related to change between 
grades 9 and 12 in the student's relative standing within the group in 
regard to mastery of English. But the important thing to note is that it 
represents a component completely unrelated to the factors representing 
English ability in general — i.e., factors F^, F^^, and F^^ (ENGL, ENG-A, 

and ENG-B) . The feature of A-ENG (F^) that distinguishes it from ENGL (F^) 

is that on the ENGL factor corresponding grade 9 and grade 12 variables 
have about equal loadings, but on A-ENG the relevant grade 12 variables have 
substantial loadings while all grade 9 variables have negligible loadings. 
Further exploration will be necessary to pin down the exact nature of this 
A-ENG factor. It may depend on the kind of formal classwork that is offered 
in English or it may be a function of interest or lack of it — or perhaps it 
is a combination of these. Or perhaps it is something entirely different 
from any of these things. But whatever it is, it is apparent that a new 
factor of some sort is entering the picture, too late to affect any grade 9 
scores much but in plenty of time to have a major effect on grade 12 scores 
in the verbal domain — and particularly those scores related to mastery of 



the English language. If the factor represents a part of the effects of 
the school’s program in English, students in high schools and curricula 
which place a heavy emphasis on English and provide a strong instructional 
program in it should tend to have higher hypothetical scores on the A-ENG 
factor than students who don't fit this description. 

The factor appears to be independent of the socioeconomic index (P*801). 

Gain in General Information (A-INF) . This factor, which showed up for 
boys but not for girls, bears about the same relation to factor F^^ (VERBL) 

that F^ (A-ENG) bears to F^ (ENGL). It represents that component of change 

in relative breadth of general information during the high school years 
that is Independent of the student’s status in this respect as a high school 
freshman. Variables with high loadings in this factor are those in which 
twelfth-grade score is least likely to be almost wholly a function of the 
level of achievement reached by grade 9 and of the time elapsed. 

SFEED versus ACCURACY: SET AND TIMING. 

Factors SP-1 and SP-2 . Factors 8a and 8b are rather remarkable j they 
show up in exactly the same tests, and with rather high loadings, but for 
different grades . Factor 8a has all its major loadings on the grade 9 
scores and factor 8b on the grade 12 scores. The tests that these factors 
show up in are the ones that are highly speeded, especially those that 
measure some sort of perceptual task (specifically the Object Inspection, 
Clerical Checking, and Table Reading tests). The loadings are somewhat 
lower for Arithmetic Computation, which is another sharply speeded task, 
but one that clearly calls for something quite different from and considerably 
more complex than simple perception. Moderately speeded tests, such as 
Visualization in Two Dimensions and Disguised Words, both of which can be 
finished by a small percentage of the students but only by those who work 
at top speed on the tests, also have loadings that are substantial, but they 
are somewhat lower than the ones for the simple perceptual tasks. Except 
for factors 8a and 8b there is no factor that links together the speeded 
tests and only those tests. Thus it appears from this factor analysis that 
there is no single factor that clearly represents a relatively stable student 
characteristic corresponding to perceptual speed or accuracy or an amalgam 



of the two. What we have Instead is two separate factors, one for grade 9 
and one for grade 12; and because they are separate and totally uncorrelated 
it seems extremely doubtful that either of them represents any characteristic 
with a great deal of stability. Whatever factor 8a (the ninth-grade factor) 
is, most of it has vanished by grade 12. On the other hand it does not 
represent a characteristic so evanescent that it affects only one test in 
the course of a day’s testing and is no longer operative when the next 
highly speeded test is administered an hour or two later. This leaves us 
with a problem as to what kind of a factor could have temporal characteristics 
such as those described — shorter than a period of several years, but longer 
than a half hour. This is not really as wide a range as it may seem, in 
terms of the number of possible explanations It permits. However at least 
two possibilities suggest themselves. One Is that the factor represents 
the student's temporary (short-term but longer than momentary) set on the 
speed-versus-accuracy problem, and his approach to it. In any highly speeded 
test calling for performance on a task which the student can perform perfectly 
provided he devotes sufficient care to it, he may either devote an extravagant 
amount of time to each question in turn, sacrificing speed to accuracy, or 
he may zip through the test as fast as he can, sacrificing accuracy to speed, 
or he may operate on some basis that is a compromise between these two 
extremes. Which of these principles he operates on, in other words what his 
set is, may depend in large part on his interpretation of what is more 
Important in the test or group of tests, and this speed-versus-accuracy set 
under which he happens to be operating on a particular occasion may last 
long enough to affect the several tests given during the course of the day. 

Another possibility is that in the few classrooms where bad timing 
errors may have occurred more or less consistently on the speeded tests and 
have remained undetected, this would create a systematic error carrying from 
one speeded test to another and having little or no effect on the unspeeded 
tests. It should be observed that some of the highly speeded tests. Clerical 
Checking for Instance, had time limits as short as three minutes, so that 
an error of as little as one minute extra would lengthen the time about 
33 percent and presumably result in a roughly proportional increase in the 
school mean. Larger errors in timing would of course be even more serious. 

So far as we know, timing errors of this sort did not occur frequently, and 
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where they were known to have occurred the scores affected were eliminated 
from the data. But they did occur occasionally. In a few cases for instance 
kindhearted teachers felt it was "unfair” to stop a test before the students 
had time to finish, so they deliberately extended the time allowance from 
about three minutes to as much as ten minutes! Some of them explained to 
us that they had done this but others may have done it without explaining. 

And a teacher who would deliberately allow extra time on Clerical Checking 
would be just as likely to do so on the Table Reading test or any of the 
other highly speeded tests. It would take only a few undetected Instances 
of this to have a major effect on the correlations, and thus perhaps to 
produce factors where none belong and to obscure factors that really exist. 
The hypothesis that timing errors and other administrative irregularities 
might account for the two factors under consideration is of course completely 
compatible with the occurrence of separate independent factors for grade 9 
and grade 12, since there is no reason to think that administrative errors 
of this sort would carry over three years later to affect exactly the same 
students. 

Because we have no reason to favor either of the two explanatory con- 
structs proposed above — short-term set and errors in test administration — 

I we are not eliminating either in favor of the other. As a matter of fact 

I the reader will find later in this chapter, under the heading "Factors that 

I Didn’t Show Up," that we are also proposing for consideration an entirely 

j different hypothesis that allows the existence of a genuine speed-and- 

I accuracy factor common to the grade 9 and grade 12 variables. 

. 

As a matter of fact, there may be a trace of such a factor buried in 

factor F (SP-1) which is the one that may be primarily short-term set 
8a 

during the grade 9 testing. While the really high loadings on this factor 
are all for grade 9 variables, the grade 12 speeded tests also have loadings 
on it which are greater than zero by a small but visible amount. Figure 
6-2 makes this apparent. 

Some readers may wonder why factors 8a and 8b weren’t rotated in such 
a way as to produce a sizable speed-and-accuracy-of -percept ion factor having 
sizable loadings on both the grade 9 and grade 12 speeded tests, since such 

a factor would clearly be in line with expectation. The answer is that 

i 
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efforts were made along these lines but these efforts led inexorably to 
the conclusion that if such a factor were forced into the pattern it would 
automatically bring with it as a partner an uninterpretably bipolar and 
therefore unacceptable factor. Figure 6-2 provides graphic evidence on 
this. In that figure, loadings of the speeded tests (and socioeconomic index) 
on factors 8a and 8b have been plotted. The two dotted lines (Fg^ Fg^) 

show one rotation of axes that was considered carefully and rejected. 

would have had the advantage of resembling a factor in which all the speeded 
tests had loadings that not only were fairly large but also were about 
equal for the grade 9 and grade 12 measures, while the unspeeded tests 
would have had loadings very close to zero. This would have been convenient 
but the other part of the package, factor Fg^i would have had substantial 

positive loadings for the -grade 12 speeded tests and substantial negative 
loadings for their grade 9 counterparts, (or vice versa). In an earlier 
section of this chapter the general uninterpretability of bipolar factors 
was emphasized, and factor Fg^ is a case in point. At least no simple and 

reasonable interpretation for a factor of this sort occurs to the author. 

It could not be anything of the sort hypothesized for factor 8b which 
isn’t bipolar, since an explanation such as timing errors or short-term set 
in grade 12 would have to work retroactively . For instance if a group of 
students were allowed too much time on a speeded test in 1963 this would 
have to cause them to have been in a situation in 1960 which tended to 
reduce their grade 9 score below average. Any factor that cannot be explained 
without resorting to some logical absurdity like retroactive causation has 
to be eliminated from the solution even though this necessitates the 
elimination of a plausible factor like 8d. Since it appeared impossible to 
rotate a factor like 8d into existence without also introducing a logically 
absurd factor 8c, efforts to rotate these factors were abandoned and the two 
varimax factors, 8a and 8b, were retained. 

Perhaps the search for a large factor linking the speeded tests is a 
search for something that just doesn’t exist. After all, the type of 
perceptual speed called for by the Object Inspection Test (F-440) is quite 
different from the type called for by Clerical Checking (R-430) or Table 
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Reading (F-420). And of course the Arithmetic Computation Test (F-410), 
although highly speeded just as the other three tests mentioned above are, 
is entirely different from any of them in what it measures directly. 

OTHER FACTORS 

Rural Factor ( RURAL ) . This is a factor on which students living in 
rural areas probably have an advantage over city boys and girls. The highest 
loadings are on Farming Information (R-113). Other comparatively high 
loadings for the boys are on Hunting Information (R-145). The loadings on 
Fishing Information (R-146) and Mechanical Information (R-112) are moderate. 

As a matter of fact, Mechanical Information has far higher loadings for girls 
than for boys. The loadings for girls are also high on Home Economics 
Information (R-114) , Biological Science Information (R-108) , and (for grade 12 
only) Hunting Information (R-145). All this seems quite reasonable in 
factors which differentiate country boys and girls from their city cousins. 

Fishing and Hunting Factors (F&H . FISH , HUNT ). For the boys the 
Fishing and Hunting factor (F^q) has its highest loadings on Fishing and 

Hunting Information (R-146 and R-145), of course; it also has significant 
though low loadings on measures of knowledge about other aspects of outdoor 
life, such as the information scales in Outdoor Activities (R-147) and 

Biological Science (R-108). Mechanical Information (R-112) also has a | 

sizable loading on the factor. 

For girls, fishing and hunting split into two separate factors (F, « 

X Ucl 

^lOb^* 

Bible Information (BIBLE ) . The only high loading on this factor is, 
as the factor name implies, for the Bible Information scale (R-142). However 
there are also significant loadings on Reading Comprehension. What this 
factor apparently measures is that component of information about the Bible 
that is left after the general information component (VERBL) has been 
i extracted. In this connection it should be noted that the loading of the 

Bible Information scale on BIBLE is at least slightly higher than the loading 
1 on VERBL. 
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Memorization Factor (MEM) This factor represents a kind of associative 
learning ability — the ability to memorize partly meaningless verbal material 
by rote, and retain it in memory for a few minutes. It is important to 
recognize the distinction between this factor and VERBL, a factor which 
involves the tendency to acquire and remember for an indefinite time a wide 
variety of meaningful material. The Memory for Words test (R— 212), which 
is the only test that loads on MEM, has its highest loadings on that factor 
but it also has very substantial loadings on VERBL. 

Common Sense (SENSE). This factor has its loadings on the Scientific 
Attitude scale (R-109). A somewhat more accurate name than "scientific 
attitude" for what the R-109 scale measures might be "rational approach," 
or "practical judgment," or "common sense." "SENSE" (from "common sense") 
is therefore the mnemonic that was chosen. 

The tests which have the highest loadings on SENSE besides Scientific 
Attitude (R-109) are Arithmetic Reasoning (R-311); Reading Comprehension 
(r- 250); Accounting, Business, and Sales Information (R-139), for boys; 
Practical Knowledge (R-140), for girls; and, somewhat puzzlingly, Effective 
Expression (R-235), for both sexes. 

Some Other Minor Factors . In addition to the common factors discussed 
above there are 20 others, of relatively minor importance, that show up for 
both the males and the females, six additional ones for males only, and five 



^This factor is probably a little bit larger than it should be, for both 
sexes, and Factor (HOMEC) , consisting primarily of Home Economics 

Information (R-114), is likewise probably a bit too large, since the corres- 
ponding three off-diagonal residuals (R-212 male, R-212 female, and 
male) for correlations between corresponding grade 9 and grade 12 variables 
are not only negative but are by far the largest numerically of the residuals 
between corresponding variables. (Minor computational anomalies of this 
sort are probably attributable to the occasional use of too high communality 
estimates in the corresponding diagonal cells. It will be recalled that 
multiple correlations are not systematic underestimates and that therefore 
they may occasionally be overestimates. In such cases, if we may hazard a 
momentary lapse into anthropomorphism, the principal factor procedure 
"works too hard" to reduce this excessively high diagonal term to zero, and 
in so doing happens also to reduce the correlation between the grade 9 and 
grade 12 scores on the variable excessively.) See Tables 6-6 and 6-7. 
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for females. All these minor factors are either varimax factors with heavy 
loadings on only a single test (both grade 9 and grade 12) or test-specific 
common factors, which by definition have their only loadings on a single 
test. These factors will not be discussed separately here, since their 
nature should be readily inferable from Tables 6-9 and 6-10. Loadings on 
the test-specific factors are shown in the next-to-last pair of columns in 
Table 6-10. 

Shifts in Factorial Pattern between Grades 9 and 12 

Examination of Table 6-10 makes it apparent that there are substantial 
differences between the factor patterns of the grade 9 variables and their 
grade 12 counterparts. But how are we to interpret these shifts? Are they 
changes in what the tests measure or what the students' tools are with which 
to attack the tasks the tests present? In other words is it the factorial 
composition of the tests that changes or is it the factorial organization 
of the students' abilities? 

This is one of the major questions raised by Thorndike in his paper 
on "Intellectual Status and Intellectual Growth" (1966), and discussed in 
Chapter 3. The other major difficulty he mentions, the problems of deter- 
mining whether unit size is constant at different levels of the score scale, 
is highly relevant to the dilemma under consideration here. 

I 

j For instance there are some tests in the battery that show large systematic 

shifts in factor loadings between grades 9 and 12 for virtually all factors 
I that are relevant in either grade. The tests for which this occurs are 

primarily measures of subject matter achievement or information. Math III 

;| (R— 333) is a notable case in point. Its grade 9 loadings are almost all very 

) 

I low, but its grade 12 loadings are high on MATH and moderate on VERBL. This 

( 

! is almost certainly a result of the fact that Math III was designed to measure 

1 

achievement in grades above the ninth, and that because it functions in the 
way that was intended, its grade 9 reliability is low. The low reliability 
probably affects the unit size in terms of the underlying variable. More- 
over, performance on a test measuring mastery of an area in which one has 
received no formal instruction is almost certainly based on different sorts 
of components from those that affect performance after three years of formal 
instruction, 

I 

j 

o 
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Furthermore, even for those tests where the loadings remain almost 
unchanged, this doesn’t necessarily mean that the elements contributing to 
test performance are unchanged. The factorial components of test performance 
are not necessarily identical with the "absolute components" that determine 
"absolute level" of a person’s performance on a test. All that factorial 
components represent is the person’s relative standing within the group on 
which the factor analysis is based. There is no evidence on factors that 
may differentiate members of that group (in our case high school students 
who reach grade 12) from others. But although uniformity of factorial 
loadings from grade to grade would therefore not necessarily indicate stability 
of the "absolute components. " changes in factorial loadings do strongly 
suggest changes in absolute as well as relative components. 

But even more important, when the factors themselves (and not merely 
the magnitude of the loadings) are different ones, it can be regarded as 
fairly conclusive proof that a real change, independent of the effects of 
variation in unit size on the variable, has occurred. It is in this connection 
that the existence of "change factors" such as A-ENG and A-INF is especially 
significant. Thus it would appear that At least some of the shifts in 
loadings between grade 9 and 12 represent real changes and not mere artifacts. 
And if, as seems likely, these real changes are changes in the factorial 
organizatioh of abilities rather than merely in test scales, it is reasonable 
to follow up with an attempt to find some clues oh a basic question about 
the developmental pattern of mental abilities. 

Various researchers have proposed the theory that intellectual aptitudes 
are undifferentiated in infancy and that specialized abilities are gradually 
differentiated out of the one general ability factor, as the child matures. 

If this theory is correct, one would expect that in the present study the 
greater 'maturity of the students by the time they reach grade 12 would 
result in a smaller percentage of the common variance in this grade being 
attributable to the general factor and a larger percentage to group factors 
than in grade 9. The actual results appear to lend some credence to this 
theory. Equally plausibly, however, the results can be explained in terms 

of the effects of different courses of study. (Prior to high school, the 
curriculum is far more uniform, thus producing a somewhat more potent 
general factor whose relative importance diminishes as a result of differing 
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curricula and extracurricular activities in high school.) As seen in 
Table 6-13 (last two columns, top two rows) the proportion of the common 
variance of the males that is due to the general factor drops from 
36 percent to 22 percent between grades 9 and 12, while for females 
it drops from 37 per cent to 32 percent. The smaller drop for females 
may be due in part to their earlier maturation — and perhaps in part to the 
fact that the factors involved are probably not identical for the two sexes. 

Factors That Didn^t Show Up 

The factors that were turned up in the final factor pattern proved, 
on the whole, to be quite interpretable and reasonable. None of them was 
really puzzling. The few puzzles in the outcomes lay in factors that didn* t 
turn up rather than in the ones that did . 

It will be recalled that at least two "change factors" — factors with 
substantial loadings on a subset of the grad^ 12 variables but with essentially 
zero loadings on the corresponding grade 9 variables (and on all the other 
variables as well)' — showed up. But no such change factor showed up in the 
mathematics area, where it might very well have been expected. To anticipate 
the results to be presented in Chapter 8, it is shown in that chapter that 
there is a definite relationship between the changes in scores on most of 
the mathematics tests (more specifically, on R-106, R-312, and R-333, but 
not on Arithmetic Reasoning, R-311) and the number of college-preparatory 
mathematics courses taken in high school. But no factor of this sort, link- 
ing the grade 12 scores on R-312, R-333, and R-106 came out of the factor 
analysis — nor could such a factor be forced into existence by subjective 
rotations. Knowing (from the evidence of Chapter 8 and from our own knowledge 
of the content of the tests in question) that such a factor must exist, we 
are obliged to seek an explanation for its failure to manifest itself in 
the factor analysis. It is the author's opinion that this non-appearance 
of a mathematics change factor is due to one of the limitations of factor 
analysis, arising from the essentially indeterminate character of the solutions 
it yields. The hypothesis offered here is that the compression in number 
of common factors that arises from the effort to do the factor analysis in 
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such a way that this number will be the minimum possible may sometimes result 
in the forced reduction to fewer common factors than really are operating. 

An automatic reduction of dimensions occurs in factor analysis when the pro- 
cedure chosen Involves (as it almost always does) an effort to account for 
the Intercorrelations in terms of the smallest number of common factors 
mathematically possible. For instance, to take a hypothetical case, suppose 
there are thre.e tests and that each of the three correlation coefficients 
is accounted for by a different common factor. That would mean there really 
are three common factors (at least insofar as "real" existence can ever be 
ascribed to statistical factors). But it is wall known that in such a case 
it is always possible, through choice of an "optimum" set of communallty 
estimates— 1. e. , a set that reduces the number of common factors to a 
minimum — to reduce to just one the number of factors required to explain 
the common variance. Furthermore this single factor would be quite different 

from any of three "real" factors. And likewise if there were three "real" 
common factors underlying four tests and explaining the Intercorrelations 
among them, the "optimum" set of communallty estimates would indicate only 
two such factors. This artificial compression of factors would probably 
be the result of unduly low communallty estimates — in other words estimates 
that permit a mathematically reasonable solution but one which heppens not 
to fit the facts very well. And under the usual circumstances there would 
be no way of knowing that this artificial shrinkage in number of common 
factors had occurred. 

It is hypothesized here that an accident resulting from just this sort 
of dimension reduction, but on a somewhat larger scale (l.e., a 95-varlable 
matrix Instead of just three or four variables)! has caused the mathematics 
change factor to be compressed out of existence. ' 

The one other glaring gap in the factor analysis results was the already 
mentioned lack of a general speed-and-accuracy-of-perceptlon factor. Whatever 
general speed-and-accuracy-of-pei'ceptlon factor may exist apparently loses 
its identity in the factor-analytic process (or at least is muddled up enough 
to make identification difficult). This factor, if it exists, may therefore 
show up chiefly as bits and pieces incorporated into a "general factor" 



I 



6-79 

or some approximation of one (e.g., factor F^^), and in other common factors. 
The most plausible hypothesis as to why this should have happened seems to 
be that the same sort of mechanism is operating here to suppress a real factor 
such as that to which the lack of a mathematics change factor is attributed. 

Furthermore the same phenomenon may explain why two English factors 
(other than Fg, A-ENG) showed up for the girls (i.e. factors F^^ and F^^) 

and only one for the boys (F^) . The two factors may have collapsed into 

a single one for the boys through the same kind of factor compression effect 
we have been hypothesizing to explain the nonappearance of certain other 
factors. (The same explanation might also apply to the absence of a 
A-INF factor for the girls.) 

None of the foregoing is to be regarded as an effort to depreciate the 
very real value of factor analysis as a tool of research. Like all other 
tools of research it has limitations, and in this section we have been merely 
focusing on one of them with the purpose of better understanding the results., 
Doubtless with slight modifications of technique, the details of which 

remain to be worked out, it would be possible to reanalyze the data in such 
a way that these two factors that we feel exist would appear. One possibility 
that seems quite plausible is that the missing factors would be given room 
to reappear if the initial communality estimates for the variables involved 
were raised a little. (This would also result in some modifications of the 
factors that now appear.) The procedure, under these circumstances, could 
continue to be principal factor analysis followed by rotation. But it is not 
within the scope of the present study to attempt to develop and try out the 
techniques that would be required for such a reanalysis of the data. 

Rather, for present purposes it is wholly sufficient to recognize that 
the missing factors almost certainly exist, since there is evidence elsewhere 
of their existence (in Chapter 8, for example, for the mathematics change 
factor). As long as the whole picture is borne in mind and these two 
factors are realized to exist and are taken into account in any decision- 
making based on the outcomes it isn’t really important whether their direct 
source is the factor analysis itself or some other data analysis. 
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£.s^choni6trl.c IinpXi, cfltions of the Tsst— Spscif i,c Doublcut Factors 

It will be recalled that for each sex as many as 23 test-specific 
doublet factors were extracted, of which 16 for each sex matched test- 
specific factors for the other sex and two for each sex were for tests 
having near-doublet varlmax factors in the other sex. (Thus, considering 

the two sexes jointly, as many as 30 different tests yielded test specific 
factors.) 

The fact that each of these factors accounts for only a very small 
percentage of total variance does not mean it is unimportant. All it means 
Is that with so many variables In the factor analysis the total variance 
Is very large j a factor with loadings In only two of 95 variables necessarily 
accounts for a much smaller percentage of the total variance than It would 
If there were fewer variables and therefore a smaller total variance. The 
specific variance associated with Music Information (R-104) for Instance, 
though small. Is not necessarily unimportant. As a matter of fact this 
specific variance Is no less Important In a factor-analyzed battery of 95 
variables than It would be In a battery of only six variables. If anything. 

It Is much more Important because variance that is specific to one test among 
47 Is much more clearly specific than variance specific to one test among a 
half-dozen would be since most of such variance would probably have turned 
out not to be specific if more tests had been Included. 

The existence of as many as 25 doublet and near-doublet factors, for. 
each sex, with each such factor corresponding to the ninth-grade and 
twelfth-grade score'* on just a single test has Important psychometric 
Implications, as has already been suggested. These doublets would have been 
true specific factors having a loading on only a single variable and therefore 
not showing up at all among thv'i common factors. In a factor analysis of the 
usual sort based on only a single set of measures rather than a replicated 
set. This points up that it is not sound practice to automatically eliminate 
tests from a battery merely because they lack substantial loadings on common 
factors. All too often it Is assumed by factor analysts that all unique 
variance Is unreliable variance. That conclusion might very well be true In 
some batteries but it clearly is not true in the TALENT battery, since by 



means of a factor analysis of a battery that was administered twice, variance 
that would normally appear as unique variance has been shown to be reliable. 

Effects of Basing Factor Analysis on Retest Data 

Number of Common Factors Extracted . ' In the present factor analyses 
40 common factors, all of them Interpretable, were extracted for males and 
40 for females. This is probably a much larger number than is usual, even 
for a large battery. Perhaps we can attribute the increase in part to 

methodological innovations such as the use of multiple R Instead of multiple 
2 

R in the matrix diagonal, and the extraction of additional factors (the 
doublets) to supplement the principal factors. But most of the Increase 
in number of common factors is almost certainly due to the fact that the 
same tests were administered twice. That is what caused the doublet factors 
to exist. If the tests had been administered in grade 12 only, only about 
11 or 12 common factors would have turned up— —and even fewer If the single 
administration occurred in grade 9 since the "change factors" (A-ENG and A- INF) 
would not have appeared under those circumstances. Obviously If the testing 
had been confined to a single grade none of test-specific factors would have 

been extractable as common factors. Nor would any of the other factors 
(l.e., the varlmax and subjectively rotated factors) that function as vir- 
tually test-specific factors (e.g., factors through F^^g) have shown up. 

The 11 common factors that probably would have shown up in a grade 12 factor 
analysis would be VERBL, MATH, SPACE, ENGL (or ENG-A and ENG-B for females), 
TECH, A-ENG, and for males only. A- INF (but neither of these change factors 
would have been properly identifiable), SP—2 (which also would almost 
certainly have been misinterpreted), RURAL, SENSE, and F&H (for males) or FISH 
(for females). (Factor 10b; HUNT, from the females* factor analysis would 
almost -ertainly have been lost since it loads on only one variable. Hunting 
Information.) The BIBLE factor might have shown up on a single-grade factor 
analysis since in addition to its large loading on Bible Information (R-142) 
it has a small but significant loading on another test, Reading Comprehension 
(R—250) . BIBLE would thus be the twelfth within— grade common factor. 
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Comparison with a Within-Grade Factor Analysis * It is interesting to 
note, in passing, that the number of common factors we are surmising would 
be extracted from a within-grade factor analysis of the data (i.e., 11 to 12 
factors) is just about the same as the number extracted by a colleague, 

Paul Lohnes, from an entirely different set of TALENT data. Using a group 
representative of the entire TALENT sample rather than just the retested 
students, he found 11 common factors among 60 TALENT variables in the cognitive 
domain, after eliminating the effects of grade and sex (Lohnes, 1966). 

There appears to be considerable overlap between the conclusions he draws 
and the conclusions presented in this report after the differences in the 

nature of the basic data are taken into account. What differences do exist 
are probably largely due to number of test variables included in the matrix 
(60 versus 47), the specific set of variables included, methodological 
differences in initial solution, and differences in rotation. Further 
rotation of one or both of the solutions could almost certainly bring the 
two factor patterns even closer together, at least with respect to that part 
of the retest factor solution that involves within-grade factors. The fact 
that even though the purposes of the two analyses are entirely different 
their results are essentially quite similar (within the limits imposed by 
the difference between a within-grade analysis and an across-grades retest 
analysis) is to be regarded as evidence supporting both solutions, and 
suggesting that each is valid for its own purposes. 

Effect of Retest Data on Factor Interpretation . It will be recalled 
that we asserted, a few paragraphs ago, that some of the factors extracted 
would have been misinterpreted if they had been derived from a within-grade 
factor analysis instead of from retest data. Among these factors would be 
the ones now called A-ENG, A-INF, and SP-2 (or its partner, SP-1, if the 
within-grade factor analysis had been for grade 9 instead of grade 12). 

The A-ENG factor would almost certainly have been regarded as another 
factor of the same type as factor F^ (ENGL), if, indeed, it hadn’t been 

swallowed up in it and disappeared entirely. Similarly A-INF would either 
have been swallowed up in F^^ (VERBL), or would be regarded as merely a 



variant of it. The essential character of A-ENG and A-INF, as measures of 
change independent of initial status, would have gone unrecognized. 

Likewise SP-2, Instead of being regarded as a rather puzzling and ambiguous 
phenomenon, that might chiefly represent either short-term set or test 
administration irregularities or even some complex combination of both, 
would confidently, but erroneously, be interpreted as representing a large 
and stable speed-and-accuracy-of -perception factor that would carry across 
several grades. Thus it requires a retest situation to demonstrate that 
these factors lack grade-to-grade stability — just as a retest situation 
helps to demonstrate that factors representing specific variance within 
grade may possess considerable stability across grades, in the form of test 



specific doublet factors. 



Chapter 7. EFFECTIVE AND INEFFECTIVE HIGH SCHOOLS: FACT OR MIRAGE? 



What determines how much a student learns during his four years In high 
school? It Is well known, of course, that the more able a student Is, the 
faster he Is likely to learn. The mental endowment he brings with him when 
he enters high school Is a major factor. But Isn't there more to It than 
this? Even though bright students usually learn faster, better, and with 
less effort than their not-so-brlght classmates, aren't there some kinds of 
school milieus In which bright students might make even larger gains than 
In typical schools? In other words aren't there superior schools as well 
as superior students? And aren't there also some substandard schools — 
schools whose students do not receive as good an education as they might If 
they went to some other school? It was In search of clues to the answers 
to these questions that the analysis discussed In this chapter was undertaken. 

The basic Idea was to carry out a two-stage study, each stage being 
designed to yield the answer to an Important question. The purpose of the 
first stage was to answer. If possible, the question as to whether some 
schools are more effective than others. Contingent on demonstrating the 
existence of such Inter-school differences, the second stage was intended 
to seek ways In which the more effective schools differed from the less 
effective ones, with a view to finding out what school practices were most 
likely to have demonstrably successful results. 



PROCEDURE 



The statistical procedure used was a combination of univariate and 
multivariate analysis of variance, together with discriminant function analysis 
The variables whose variance was analyzed, ■ in other words the "dependent 
variables," were grade 12 scores. The grade 9 scores were used as covarlates. 



The computer program used, the MANOVA program, developed by Charles E. Hall 
and Elliot M. Cramer (1962), yields these several kinds of statistics as 
part of a single "package." The acronym MANOVA stands for Multivariate 
ANalysis Of VAriance. 



7-2 



Thus initial ability, as represented by grade 9 scores, was controlled 
statistically. 

The basic idea was to analyze the gain in score between grade 9 and 
grade 12 to see whether there was any significant difference among schools 
respect, above and beyond those attributable to differences in 
initial ability level of the students. In addition, grade 9 and grade 12 

scores were analyzed without covariates. 

The groups of students compared were those in different schools. 

School, in other words, was the single "design factor" in a one-way analysis 
of variance. For this purpose the schools were grouped in four overlapping 
sets, each set consisting of schools taking any one of three retest batteries 
(or for one set four) having in common a large number of test variables 
suitable for inclusion in a study of this sort. The retest batteries and 
numbers of students, schools, and variables that were involved in this mode 
of data organization are summarized in Table 7-1. 

The test variables Included were mostly the ones included in the correla- 
tion matrices in Tables 6-la and 6- lb. The most important change was the 
omission of the highly speeded tests from the present analysis. This was 
done as a direct result of the two test administration factors IFg^ and Fg^j 

that showed up in the factor analysis and suggested that there had been 
systematic timing errors in the highly speeded tests in at least a few of 
the classes in some of the schools. Inclusion of the affected tests in the 
present analysis would have produced misleading evidence about basic school 
differences. 



RESULTS 

Differences between Grades 9 and 12 

Tables 7-2a through 7-2d summarize the univariate data that resulted. 
These four tables contain the results of the analyses of variance carried 
out for each test individually. Also shown in these tables are the mean 
scores for grades 9 and 12, the difference between them (i.e., the mean gain), 
the withln-grade standard deviation (for grade 9), and the ratio of the mean 
gain to this within-grade standard deviation. 
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TABLE 7-1. Summary of the constituents of the four sets of data discussed 
in Chapter 7 



For analysis of 


For analysis of 


No. 


of 


Retest 


males 


* data 


females 


' data 


dependent 

variables 


Batteries 


No. of 


No. of 


No. of 


No. of 


Gr. 


Gr. 




schools 


male 

a 

students 


schools 


female 

a 

students 


9 


12 




65 


1682 


59 


1867 


15 


15 


ABCV 


44 


1242 


44 


1422 


15 


15 


ADE 


51 


1482 


51 


1655 


10 


10 


BDF 


50 


1610 


50 


1671 


6 


6 


CEF 



Cases included were students in retest classification 0 (see Appendix C-5) 
who were in the same school or school system when they were retested in 
grade 12 as when they were originally tested in grade 9. 



o 

jc 












TABLE 7-2a. Analysis of differences among schools on grade 9 and grade 12 test scores 
and on gains with covaxiate control on grade 9 scores^ 

Based on selected tests in retest batteries A, B, C, V 
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T ABLE 7-2d. Analysis of differences among schools on grade 9 ^d grade 12 test scores 
and on gains with covariate control on grade 9 scores®- 

Based on selected tests in retest batteries C, E, P 
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This ratios which amounts in effect to mean gain expressed in a kind 
of standard score unit, thus making these gains more directly meaningful 
and providing them with a kind of comparability, helps us answer the critical 
first question that must be asked in any study of whether there is anything 
the schools do or can do that affects the amount of learning or the improve- 
ment in skill mastery that occurs during the high school years. That first 
question is: "Does any such gain occur, and if so is it large enough to be 
of practical significance?" After all, unless worthwhile gains are occurring 
somewhere, there is little merit to a study to determine whether and how 
schools differ in the degree to which they are able to produce those gains. 

Let us look, therefore, at the columns in Tables 7-2a through 7-2d 
that show the gains expressed in comparable units. These are the columns 

that are headed and the nimibers in them are by no means insignificant 

% 

or trivial. It has become a commonplace to remark that the differences 
within a grade are greater than the differences among grades. This observa- 
tion is still a true one and still Important and there is nothing in the data 

presented here to contradict it. But in the — columns of the four tables 

9w 

we are seeing the opposite side of this coin. Differences among grades do 
exist, in all areas, and they are uniformly in the right direction (the 
direction of progress rather than retrogression, of increase rather than 
decrease). Furthermore the gains in important areas are certainly large 
enough, in most cases, to escape the label "trivial," and in the more 
important areas they are generally quite substantial in magnitude. Except 
in a very few areas the average gain between grades 9 and 12 is at least 
half a standard-deviation unit and in some cases, notably Literature 
Information (R— 102) and, for boySf Mathematics Information (R-106) and 
Advanced High School Mathematics (R-333), the average gain is over one full 
unit. Thus when we speak of the gains that occur between grades 9 and 12 
and speculate on what school policies, principles, and procedures, if any, 
are effective in producing these gains, we are talking about gains that 
are large enough to be worth talking about. 
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It is encouraging to note that the larger gains generally tend to be 
associated with school-taught subjects— or areas such as vocabulary that 
if not taught dlrectl^^ are at least fields in which most schools would like 
to Increase their students' mastery and promote growth. Thus, other areas 
in which growth in knowledge or ability is fairly large between grades 9 and 
12 are information about law (R-132), information about accounting and business 
(R-139) , electrical and electronic information (R-111) , and mechanical 
Information (R-112). All of these areas of substantial growth are curriculum- 
related (though not all are related to the academic curriculum). The test 
scale on Law Information necessarily has considerable overlap with the social 
studies curriculum, since it Involves, among other things^ such matters as 
legal safeguards on constitutional rights. Information about accounting and 
business is impacted in commercial courses, and mechanical and electrical- 
electronic information are of course staples of vocational curricula. 

Electrical aiid electronic information is also an Important component of 
academic courses in physics or general science. 

Differences among Schools 

Having established that growth in mastery does occur in all areas and 
that particularly in curriculum-related areas it is often substantial in 
magnitude, the next question that arises concerns whether there is any 
evidence that schools differ in these respects. (If it were to develop that 
schools do not differ in regard to their effectiveness it would be rather 
hopeless to seek clues concerning what general or specific behaviors on 
the part of schools are likely to be effective.) 

In studying school effects it is not sufficient merely to consider the 
grade 12 results and to claim they represent what the high school has done. 

They don't, unless one can assume that the high schools all started out 
with equivalent student bodies having identical distributions of test 
scores at entrance (or grade 9 scores) and identical distributions of 
environmental characteristics (both home and community). We fciow, of course, 
that this isn't true. If a high school in a prosperous suburban community 
has /higher grade 12 scores, on the average, than its counterpart in a slum 
neighborhood in a large city it certainly does not mean that the suburban 
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school is necessarily doing a better job. Rather, it is quite possible that 
the better showirig made by the suburban school is the result of a combination 
of two potent factors: (1) that the students entered the high school with 

higher aptitude and achievement levels than their disadvantaged contemporaries 
from the depressed urban area, and (2) that the better environmental factors 
provided by home, family, and community in the prosperous suburb tend to 
promote more out-of-school learning than is typical in less favored situa- 
tions o 

What all this means for the present research is that if we wish to 
find out whether schools differ in their effects it is not at all adequate 
merely to examine the grade 12 data; the grade 12 results must be corrected 
by taking into account the initial situation (as represented in the case of 
Project TALENT by the grade 9 scores). This is accomplished by treating the 
grade 9 scores as covariates, and analyzing the resultant residuals. 

Therefore for each variable in Tables 7-2a, 7-2b, 7-2c, and 7-2d three 
analyses of variance were carried out for boys and three for girls — one on 
the grade 9 results, one on the grade 12 results, and one on "residual 
gains" — in other words on grade 12 scores with covariate control on the 
grade 9 data. In all cases the groups compared were schools. The results 
are shown in the columns headed F^, ^ 2 ^ 2 * ^12 9 four tables. 

All of the F ratios not only for grade 9 and 12 individually but for 
gains as well, in Tables 7-2a, 7-2c, and 7-2d, are significant at the .01 
level, and most of them even at the .001 level. In Table 7-2b too, a 
great many of the F ratios are significant at the .001 level and almost all 
of them at the .01 level. There are only five F*s in the entire table that : 
do not meet this latter standard of significance, and four of them (three 
for girls and one for boys, two for grade 9 and two for gains), are significant 
at the .05 level. These four all concern recreational activities of a sort 
in which direct instruction is not normally offered in high schools (hunting, 
fishing, and indoor games, such as chess, checkers, and cards). The single F 
ratio in the entire set that turned out not to be significant at any level 
was the girls* F ratio on gains in the Architecture Information score (R-135). 
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The conclusion to be drawn from all of this, and particularly, of course, 
from the high ¥^2 9 values con esponding to the covariance analyses, is 

that in any area of knowledge or ability represented by the TALENT testis 
under consideration students in some schools learn more, or improve their 
ability more, than in other schools. But this does not imply that the 
schools themselves are necessarily responsible for this outcome. The most 
that we can conclude is that entities represented by school-plus-community- 
plus-the-people-in-it do differ in the degree to which growth of knowledge 
or increase in ability occurs during the high school years, so that whether 
it is the school or other aspects of the neighborhood or community that 
bear the major part of the responsibility is a moot question. 

It will be noted that the conclusion stated above says nothing about 
schools per se differing in effectiveness. It refers, rather, to the differ- 
ing effectiveness of a complex entity described as school-plus-community- 
plus-the-people-in-it (which we shall start referring to merely as "school- 
plus," in the interests of brevity). This caution is necessary in the 
present context. In interpreting the results of an analysis such as the one 
under consideration, there is no way of distinguishing clearly and definitely 
between effects of what the school does and effects of other environmental 
influences, such as family and community. Fortunately, however, the necessity 
of omitting environmental factors from the set of variables considered in 
this analysis^ is of relatively little Importance, since it was possible to 
include socioeconomic index systematically as a variable in the Chapter 8 
analyses, where its inclusion is much more useful, because the individual 
rather than the school is the unit of study in that chapter. And even from 
the analyses in the present chapter it is possible to draw some tentative 
inferences about the amount of effect that the "school-plus" entities have. 



In view of capacity restrictions on the computer program and other practical 
considerations, it was not feasible to incorporate in this data analysis 
any socioeconomic variables or other direct measures of community and 
family characteristics. 
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More specifically, we can tentatively infer, from the relative size of 
the F’s for a group of schools, which F*s primarily represent differential 
school effectiveness and which ones primarily represent differential community 
effects. These inferences are based not on the statistics hut rather on 
knowledge of what each test measures and what part of it is likely to be 
covered in the school curriculum either directly or indirectly and either 
partially or wholly. Looked at from this point of view, the data of Table 7-2a, 
which contains the results for the Information Part I scores, suggest that 
the schools themselves are playing a rather important role in determining 
the effectiveness (or ineffectiveness) of the "school-plus"^ units of 
which they are parts. There seems to be some tendency for the larger F’s 
to be associated with curriculum-related subjects. (This is in line with 
the finding, mentioned earlier, that the variables for which the ratio of 
mean gain to within-grade standard deviation is relatively large are likely 
to be curriculum-related.) The largest Fj^2.9 

girls, is for Literature Information (R-103). Other relatively high ones 
are for information in mathematics (R-106), social studies (R-105), and 
electricity-electronics (R-111), an area closely related to the physical 
science taught in the academic curriculum. 

Farming Infotmation (R-113) seems to be one exception to this generaliza- 
tion about the curriculum- relatedness of the tests with high ^2.2,9 

Community effects (rural VS. urban) may be operating here to raise the F, 
rather than school effects. 

Most of the large F values that show up in Table 7-2b, which contains 
the results for the Information Part II scores, appear to be primarily a func- 
tion of community differences rather than school practices. Again, as in 
the case of the earlier consideration of raw gains scores, information 
about law (R-132), which is curriculum-related via its close association 
with social studies, may be an exception. But many of the scales of 
Information Part II cover recreational activities and hobbies — hunting, 
fishing, theater and ballet, etc. ,— and the prevalence of some of these 



^For an explanation of this term, see page 7-11. 



activities among students in a particular type of school may be largely a 
matter of type of community. Boys in a rural area, for instance, are 
undoubtedly much more likely to have hunting as a hobby and consequently 
to know a lot about it than are city boys. Likewise knowledge about legitimate 
theater and ballet is in part a matter of living in a community where there 
is enough live theater for one to have the opportunity to acquire information 
in this area, and partly a matter of being in a socioeconomic stratum vrhere 
theater-going is regarded as desirable behavior. Tables 6-la and 6- lb, ^n con- 
junction with Table 4-8, provide evidence supporting this hypothesis. If one 
allows for th6 fact that the Theater-and-Ballet Information Scale (R-X50) 
has a reliability of only about .60, which, although excellent for a test 
having only eight items, is rather low in absolute terms, it has a higher 
correlation with the socioeconomic index (P*801) than almost any other scale 
in the battery. Information about foods (R-151) is another area that is 
probably dependent in large part on community characteristics (and probably 
has a substantial correlation with socioeconomic level). 

By far the largest 9 value in Table 7-2c, both for boys and fOr 

girls, is for Memory for Words (R-212). But the cause of these school ' 
differences is not clear. If we may anticipate some of the Chapter 8 f j.ndings 
for a moment, it is apparent from them that even though the Memory for Words 
test is known to be an effective predictor of success in studying foreign 
languages (Carroll, 1962), large gains on it are not a direct consequence 
of such study. Thus there is no reason to hypothesize a close relationship 
between a school's foreign language program and the kind of gains its students 
make on the Memory for Words test. Furthermore comparison of the school's 
report of its course offerings in foreign language with the performance of 
its students on the test suggests that no relationship of any significant 
magnitude exists. 

The largest F ratios in Table 7-2d, both for boys and for girls, are 
for the Reading Comprehension Test (R-250). It seems quite likely that 
this represents school effects at least to a certain extent although home 
and community factors also undoubtedly play a part. 
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Further Comments on ’’Aptitude” vs* "Achievement* * 

Table 7-2d points up the aptitude-ys. -achievement dilemma discussed 
in Chapter 5. Tests in areas such as visualization in three dimensions, 
abstract reasoning, mechanical reasoning, and creativity are customarily 
considered "aptitude tests" rather than "achievement tests" because they are 
in areas in which formal instruction is not usually explicitly offered in 
high schools. But the relatively high F's for all those areas suggest that 
the "school-plus"^ complex is affecting performance and also lend some 
credence to the notion that the schools themselves are playing a significant 
role in this. (It is hard to conceive of an entire neighborhood or community 
exclusive of the school, that has characteristics fostering or hindering 
the development of spatial visualization after due allowance has been made 
(statistically) for the level reached by grade 9. The school Itself is much 
more likely to be responsible for at least part of the effect. A strong 
program in geometry is one hypothesis. Further research, directed toward 
this hypothesis, would of course be necessary before the hypothesis could 
be established as fact.) 

Perhaps most striking of all is the significant difference among schools 
in regard to changes in Creativity score (R-260) between grades 9 and 12, 

If these changes are indeed school effects, a supposition which would need 
independent confirmation before it could be accepted, it would be most 
interesting to know what specific or general aspects of the school program, 
policies, or facilities brought it about. 

In any event the data of Tables 7-2a through 7-2d may have given the 
Qoup de gvdoe to any lingering notions among researchers that it is possible 
in studying performance at high school age to draw a sharp distinction 
between measures of a category of abilities called "aptitudes" which are 
allegedly impervious to external effects (training, education, etc.) and 
another category called "achievement" which admittedly are very much subject 
to the effects of education (as well as to the effects of the "aptitudes"). 



For an explanation of this term see p. 7-11. 
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"Aptitude measures" and "achievement measures" are still handy labels 
for identifying certain categories of tests, and the terms are therefore, not 
likely to be abandoned in a hurry. And there is still a very strong likeli- 
hood that what have commonly been called "aptitudes" are relatively resistant 
to the effects of specific training and educa ion. Nothing in the findings 
of this research Indicates anything to the contrary. All that has really 
been suggested is that "aptitudes" are not wholly resistant to environmental 
effects (specific training, education, or some other more general environ- 
mental factors). It is a matter of degree not of kind. Only the notion of 
a sharp clear wholly unambiguous line that can be drawn separating aptitude 
and achievement need be relinquished— and this is likely to be relatively 
painless since many researchers relinquished that idea years ago! 

A Word of Caution on Comparison of F Ratios 

It should be noted that comparison of F ratios is only done within a 

table; the F*s are not directly comparable from table to table, since each 

table is based on a different set of schools and students. F ratios are 

group-specific. Thus unless groups are identical , as they are for all 

variables within a single table (Tables 7-2a, 7-2b, 7-2c, and 7-2d) instead 

of merely having partial overlap such as exists between the groups represented 

by any two of the four tables mentioned above, no comparison of F*s for 

# 

different variables is valid. 

The fact that the Abstract Reasoning test was administered in all 
the retest schools and that scores on it (R-290) are therefore included 
in all four sets of variables analyzed provides us with a convincing 
demonstration of the hazards involved in comparing F*s based on different 
groups. All the data of Tables 7-2a, 7-2b, 7-2c, and 7-2d relevant for this 
purpose are summarized in Table 7-4. A look at this table makes it apparent 
that corresponding F ratios differ markedly among the four groups of schools. 

We might look at the boys* F values for grade 9, testing whether schools 
differ significantly in grade 9 mean scores. The F is 2.52 for the set of 
schools to which the Table 7-2b data apply, and 6.07 for the Table 7-2d 
set of schools. If the Table 7-2b and 7-2d data applied to different tests, 
careless interpretation of the results might very well result in the conclusion 
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TABLE 7-3a: Suramaiy of overall results of univariate and multivariate 

analyses of variance corresponding to the Table 7-2a data 





M A h 


E 


P E M A 


L E 


No. of schools 
No. of students 


65 

1682 


59 

1867 




1 

i 

ro 

1 t 


^12.9 


^ ^12 


^12.9 


No. of variables 


15 15 


15 


15 15 


15 


No. of univariate F’s significant, at: 
.01 level 


15 15 


15 


15 15 


15 


.05 level 


15 15 


15 


15 15 


15 


Maximum no. of discriminant functions 


30 


15 


30 


15 


No. of discrim, functions significant^ at: 
.01 level 


16 


9 


17 


10 


.05 level 


17 


10 


18 


10 


Footnotes applying to column 


a 


b 


a 


b 



^he and columns contain the grade 9- grade 12 data respectively, 
uncorrected for covariates. 



The ^12. ^ columns contain data for residuals —in other words for grade 12, 

scores adjusted for grade 9 covariates. For each grade 12 variable, the 
covariates are all of the grade 9 variables of Table 7-2a. 

^See footnote on page 7-21. 
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TABLE 7- SB: Summary of overall results of xmivariate and multivariate 

analyses of variance corresponding to the Table 7-2b data 





M A L 


E 


FEMALE 


No. of schools 


kk 


44 


No. of students 


ro 

■Sr' 


> 


1422 




ro J 


12 • 9 


^9 ""12 


^ 12.9 


No. of variables 


15 15 


15 


15 15 


15 


No. of univariate F's significant at: 




i4 






.01 level 


15 15 


13 15 


13 


.05 level 


15 15 


15 


15 15 


l4 


Maximum no. of discriminant functions 


30 


15 


30 


15 


No. of discrim, functions significant^ at: 










.01 level 


11 


7 


12 


9 


.05 level 


11 


8 


13 


10 


Footnotes applying to column 


a 


b 


a 


b 



^he and columns contain the grade 9 grade 12 data respectively, 
uncorrected for covariates. 




scores adjusted for grade 9 covariates. For each grade 12 variable, the 
covariates are all of the grade 9 variables of Table 7-2b. 

^See footnote on page 7-21. 
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TABLE T-3c; Summary of overall results of univariate and multivariate 
analyses of variance corresponding to the Table 7-2c data 





MALE 


FEMALE 


No. of schools 


51 


51 


No. of students 


1482 


1655 




X^ X.^ 


X ^ ^ 


X X 


X 




9 12 


12.9 


9 12 


12.9 


No. of variables 


10 10 


10 


10 10 


10 


No. of univariate P's significant at: 










.01 level 


10 10 


10 


10 10 


10 


.05 level 


10 10 


10 


10 10 


10 


Maximum no. of discriminant functions 


20 


10 


20 


10 


Q 

No. of discrim, functions significant at: 










.01 level 


9 


5 


11 


7 


.05 level 


10 


6 


12 


7 


Footnotes applying to column 


a 


b 


a 


b 



^he and X^gColumns contain the grade 9 and grade 12 data respectively, 
uncorrected for covariates. 



1 ^ 

The ^ 2 .^ columns contain data for residuals— in other words for grade 12 

scores adjusted for grade 9 covariates. For each grade 12 variable, the 
covariates are all of the grade 9 variables of Table 7-2c. 

°See footnote on page 7- 21 . 
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TABLE 7-3^: Summary of overall results of univariate and multivariate 

analyses of variance corresponding to the Table 7-2d data 





MALE 


FEMALE 


No. of schools 


50 




50 


No. of students 


1610 


1671 




^ "^12 


Y 

12.9 


OJ 


y 

^12.9 


No. of variables 


6 6 


6 


6 6 


6 


No. of univariate F's significant at: 










.01 level 


6 6 


6 


6 6 


6 


.05 level 


6 6 


6 


6 6 


6 


^feximura no. of discriminant functions 


12 


6 


12 


6 


No. of discrira. functions significant*^ at: 










. 01 level 


8 


5 


6 


k 


. 05 level 


9 


5 


6 


k 


Footnotes applying to column 


a 


b 


a 


b 



^he and columns contain the grade 9 and grade 12 data respectively., 
uncorrected for covariates. 

1 ^ 

The X^2.9 contain data for residuals— in other words for grade 12 

scores adjusted for grade 9 covariates. For each grade 12 variable, the 
covariates are all of the grade 9 variables of Table 7-2d. 



°See footnote on page 7-21. 



TABLE 7-^* Comparison of analyses of variance for four separate sets 
of schools On the^Abstfact' Reasoning scores (R-290), 
testing whether schools differ significantly 
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that the Table 7-2d Abstract Reasoning test, with its F of 6.07, differ- 
entiated among high schools far better than the Table 7-2b test, with its 

F of only 2.52. Such a conclusion would clearly be totally wrong. There 
is only one Abstract Reasoning test Involved. 

It is worth noting, in this connection, that though the F's vary greatly 
among the four sets of schools. Table 7-4 shows that there isn’t much differ- 
ence among the four means for grade 9 (or for grade 12). 

The Discriminant Functions 

As has already been Indicated, the univariate phase of the analysis, 
discussed above, was supplemented by a multivariate approach in which sets 
of multiple discriminant functions were obtained. Since several types of 
functions exist that have this name and have little else in common except 
that they are linear functions of the original scores, it seems desirable 
to specify the sort that was used here. These multiple discriminant 
functions are mutually uncorrelated, and they are of the type that constitutes 
an ordered set, in which the first discriminant function is the single linear 
function that provides maximum differentiation of the groups (schools, in 
this case), the first and second combined are the pair that provides maximum 
differentiation, and so forth. Those discriminant functions thus obtained 
that are Inferred to provide real differentiation of the groups Instead of 

I , - ^ 

merely providing numerical values that represent sampling errors are the 
ones that are regarded as statistically significant.^ 

It is a useful and convenient convention to refer to the number of 
significant discriminant functions as the number of "dimensions" necessary 
in order to describe real differences among groups. This being the case, 
let us look at the numbers of such dimensions that are needed in the present 
Instances. Tables 7-3a, 7-3b, 7-3c, and 7-3d (corresponding respectively 
to Tables 7-2a through 7-2d) show the numbers of significant discriminant 
functions for each set of data, as well as recapitulating, in order to 



The procedure used for testing significance of the discriminant functions 
was to convert the appropriate Wilks lambda value to an approximation of 
chi-square, in accordance with the approximation formula developed by 
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facilitate comparison, the numbers of significant univar?ate F ratios, which 

have already been discussed at some length. Tables 7— 3a through 7-3d also 

indicate the maximum number of discriminant functions mathematically 

2 

possible for each analysis. 

The most striking thing about the discriminant functions to be gleaned 
from these four tables is the large numbers of them that are significant. 



1 (continued) 

Bartlett. The formula is? 



X, 



f(N- 



1 ) - 



n+Q+1 n . . 

log 



where 



N 

g 

P 

c 

t 

q 

A 



2 



’ number of cases 
’ number of groups 

' number of variates (not including covariates) 
' number of covariates 
' p + c 
' g - 1 

' Wilks lambda for testing the discriminating 
power f the t-test-battery when c of the 
t tests are used as covarlates, after 
extraction of i-1 of the discriminant 
functions. 

2 2 

* X approximation of 

2 

The number of degrees of freedom corresponding to is given by: 

df^ = (p-i+1) (q-i+1) 

These formulas (with slightly different notation) are presented, and the 
procedures discussed, by Cooley and Lohnes (1962). 

In the present analyses the upper limit on the number of discriminant 
functions always equals the number of raw variables in the analysis since 
there are more groups to be differentiated than variables to differentiate 
them. 



Each significant discriminant function may be regarded as representing a 
separate independent way in which schools together with the other environmental 
factors acting on the set of students considered as a whole differ in their 
effects during the last three high school years. For instance in Table 7~3a., 
which refers to the Information Part I analyses, it is seen that for the 
males nine out of a possible 15 discriminant functions with covariate control 
on the grade 9 data are significant at the .01 level and ten at the .05 
level. This means that the "school-plus"^ entities differ in a great many 
dimensions rather than just one or two. In other words one cannot really 
speak meaningfully of "good schools" vs, "bad schools" or even of good 
"school-plus-community" entities vs, poor ones. This would be a gross over- 
simplification, apparently, since some of these geographical entities are 
good (or bad) in one way and some in another, and these various ways all 
function independently of each other. 

Of course it is still true here, as it was in the case of the univariate 
analyses, that we cannot differentiate clearly between the dimensions that 
are due to school effects and the dimensions that are due to aspects of the 
community that have nothing to do with the school. (We can say, however, 
as we couldn't in the case of the univariate analysis, that there is no 
overlap between these two numbers of dimensions— those due to school effects 
and those due to other community effects— since the dimensions provide 
indepenf’^nt measures.) 

It should be recognized, of course, that the number of statistically 
significant multiple discriminant functions is not necessarily the number of 
such functions that measure magnitudes large enough to be of practical 
importance. It is merely the upper bound on the number of "important" 
discriminant functions. Moreover the fact that a discriminant function mea- 
sures differences that are not only "significant" but also large enough to 
be "of practical importance" does not necessarily mean that a value judgment 
can be attached. High scores on a particular discriminant function are not 
necessarily either "good" or "bad," "desirable" or "undesirable." This lack 



For an explanation of this term see page 7-il. 
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of value” oriented polarity in some of the functions makes direct interpretation 
of their practical significance difficult if not impossible. 

Because of these considerations the conclusions to be drawn as a result 

of the discriminant function analysis are somewhat vaguer than one could have 

2 

hoped. We can state quite definitely that the "school-plus" geographic 
entities differ in a great many psychometric dimensions and we can surmise, 
although we cannot prove, that a substantial number of these dimensions are 
school-related. 

W hy Do Schools Differ in Effectiveness ? 

Having established that the "school-plus" entities differ in their 
effectiveness and having surmised that at least part of this is due to the 
school rather than the alternative hypothesis which would be that all 
the differences among schools are due to community factors exclusive of 
school, the next problem is to try to determine what there is about certain 
schools that makes their students learn more effectively (or less effectively) 
than the students in other schools. The only feasible approach to this problem, 
with the present data, was to examine school characteristics as described on 
the questionnaires answered by the schools that participated in Project TALENT, 
and determine how they are related to the school differences in performance 
that manifested themselves. The results, however, were inconclusive. For 
instance there was no clear relation to be seen between test performance and 
such school characteristics as course offerings. Schools that reported a 
strong program in mathematics or in physical science (many courses offered. 



^Rotated discriminant functions were not available. (See footnote 1 on page 6-22.) 
^For an explanation of this term see page 7-11. 

^No correlational analysis of these data was undertaken since the records 
of course offerings of the school were not suitable for the quantified form 
needed for such analysis. 



and strong requirements for graduation) were not especially likely to be 
among those that scored higher than average in those areas. 

No specific data are presented here on this area of inquiry because the 
investigation was strictly an informal and exploratory one aimed at deciding 
whether an extensive formal analysis of the relation of residual test score 
gains to course offerings and associated school characteristics would be 
worth while. The decision was that it wouldn't be, and that other approaches 
would be more likely to lead to productive results. 

It seems likely that the lack of any readily apparent relation of the 
school characteristics under consideration to the very substantial inter- 
school differences in performance which had been demonstrated to exist 
might be due in large part to the fact that courses offered by a school are 
not necessarily taken by a large proportion of that school's students — or, 
for that matter, by the right students, those who would profit most. The 
results of the analyses described in the next chapter (Chapter 8) provide 
strong support for this hypothesis. 

In the meantime the research reported in the present chapter suggests 
that schools vary in effectiveness in a great many dimensions, even though 
the specific school characteristics that produce these differential results 
are somewhat elusive. One reason they are so resistant to identification 
may be that they are elusive inherently , not just in the present context. 

In other words one of. the crucial differences between an effective school and 
an ineffective one may be something as tenuous and resistant to identification 
on the basis of a questionnaire as the school's atmosphere — the ambience it 
provides” — or some other concept equally hard to nail down. Vague though 
this concept is, it at least has the advantage of fitting the facts and 
providing an explanation for them. For instance it would explain why number 
of courses offered in an area might be irrelevant. It doesn't matter much 
how many advanced courses a school reports it offers if few or none of the 
students take them. And this may be largely a matter of the students' 
motivation and interest. There are enormous differences among students, of 
course, with respect to their motivation to take elective courses in specified 
areas, and their interest in adding to their mastery in those areas. But 
superimposed on these normal differences among students are the differences 
produced by the school itself, considered as a motivation-generating environment. 
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The school may provide an atmosphere where the motivation to learn is stimulated 
or it may provide an atmosphere that reduces this motivation and produces 
students whose goal is to barely "get by." The quality of the faculty would 
probably play an important part in such differences. Perhaps this can be 
condensed into the suggestion that it isn’t so much what the school does as 
how it does it that matters. (Offering advanced courses but failing to inter- 
est suitable students in taking them is a case in point.) 

Some of the foregoing discussion is based on speculation, quite 
obviously, and not on hard facts— but it does fit what facts we know and 

that consideration lends it plausibility. 

In sumiEary, then, to answer the question suggested in the title of this 
chapter, effective high schools and ineffective ones are a fact, not a mirage. 
And since we have found that there are important differences among schools 
in their effectiveness, it would appear that education is susceptible of 
improvement. But since the sources of these differences among schools resist 
ready identification, there would appear to be no easy panacea for the problems 



of education. 
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Chapter 8. CORRELATES OF CHANGE: A CONSIDERATION OF CONCOMITANCE AND CAUSATION 



Some students learn more in high school than other students. Individual 
differences in aptitude of course play a major role. But what role do other 
factors play? 

It was shown in the last chapter that there are significant differences 
among schools in regard to kind and magnitude of changes in level of test 
performance occurring between grades 9 and 12, and that these differences 
still exist even after initial ability levels have been controlled statisti- 
cally (by using the grade 9 test scores as covariates). 

But what the Chapter 7 analysis couldn’t establish is the nature of 
some of the explanatory agencies Immediately underlying the differential 
gains. It will be recalled that significant differences among schools in 
regard to the changes produced in their students were found to exist in 
virtually all the cognitive areas tested. But though these differences 
were particularly large in areas such as mathematics, in other words in 
areas where specific course work might be expected to be especially potent, 
in effecting changes, no clear relationship between these differences and 
the 5?xhool*s course offerings could be established. It was therefore 
hypothesized that the differences were not so much a matter of what courses 
the school indicated that it offered or was prepared to offer as of the 
extent to which the students took advantage of the available courses by 
taking them as electives. 

Other moderating variables which it was felt might be having a sub- 
stantial, though perhaps indirect, effect on the extent to which the student’s 
mastery of various specific areas changed during the high school years 
included such things as his socioeconomic status, his plans (more specifically, 
whether he planned to go to college) , and the extent to which the school 
had had or had made an opportunity to try formally to help him plan. 

In our search for leads as to what factors are responsible for the 
changes in relative performance level that have been shown to exist, it is 
assimied that whatever factors are having an effect are probably operating 
on, or through, the individual student in one way or another, rather than 



necessarily affecting all the students in a school in a unitary way. 

Suppose, for Instance, that we are Interested in the extent to which the 
study of foreign languages improves mastery of English. Whether the school 
offers foreign language courses certainly has some relevance since without 
such a program the effect cannot occur. But merely offering the opportunity 
to take foreign languages is not likely to Improve a student's mastery of 
English if he doesn't avail himself of the opportunity. And if a school 
offers an extensive language program. It is extremely unlikely that all 
students will take advantage of it to the same extent. For these reasons, 
among others, it was decided that the student, rather than the school, should 
be the unit of study for the research reported in this chapter. 

Considerable attention is devoted in this chapter to the role of 
socioeconomic status. It is well known, from the findings of numerous edu- 
cational researchers, that socioeconomic status is correlated substantially 
with scores on many kinds of tests. Project TALENT results are quite in 
line with these usual findings, as can be seen from Matrices lA and IB 
(in Tables 6-la and 6-lb). P*801 is a variable in these matrices. It was 

shown in the factor analyses presented in Chapter 6 that the common factor 
with which socioeconomic status has its highest correlation is general 
verbal ability ("VERBL") and that the only other common factor with which 
it has a slsable correlation is MATH (for the males only). Many of the 
correlations of socioeconomic index with individual variables are substantial, 
of course, and almost all of them are significantly greater than 0. But 
it is not at all clear from these data what is cause and what is effect. 

Are the correlations due chiefly to the effect of environment on achievement 
or are they due more to the relation between the student's aptitudes when 
he reaches grade 9 and the environment in which he has been growing up? Can 
the complex of cause-and-ef feet relationships and coincidental concomitant 
relationships be sorted out sufficiently to begin to get answers to these 
questions? Efforts to do just that, and the results of these efforts, are 
discussed in this chapter. We shall try to find out, for instance, whether 
students whose socioeconomic status is low are less likely than other 
students of the same initial ability level to take college-preparatory 
courses (mathematics, foreign languages, etc.). 

Among the questions on other issues to which we shall seek answers ate 
the following: 
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1. Do students who plan to go to college learn more In high school 
than students who don’t? 

2. if so, does this still hold even if initial differences in aptitude 
are taken into account? And even if differences in socioeconomic 
level are taken into account? 

3. What is the role played by choice of courses in determining grade 12 
achievement level in various areas? Is number of courses taken in 
various areas to some extent a function of initial ability and thus 

self -adjusting or are some able students who could benefit from 
academic courses failing to take them (either through choice or 
ecause they attend a high school which doesn’t offer these courses)? 



BASIC DATA AND GENERAL PROCEDURES 



The Basic Correlation Matrices 



The results presented in this chapter are based almost entirely on 
six initial correlation matrices, and on further statistics derived from 
these six matrices. The six matrices are; 



Matrix AM: 
Matrix AF: 
Matrix DM: 
Matrix DF: 
Matrix EM: 
Matrix EF: 



Based on Retest Battery A, males 
Based on Retest Battery A, females 
Based on Retest Battery D, males 
Based on Retest Battery D, females 
Based on Retest Battery E, males 
Based on Retest Battery E, females 



The basic facts concerning these matrices (the cases going into them, 
the variables included, etc.) are summarized in Table 8-1. The matrices 
themselves are shown in Appendix J. The three batteries used (A, D, and E) 
are the ones that include the Student Information Blank (SIB). The variables 
included in each of the six matrices include most of the grade 12 test scores 
from the retest battery, the corresponding grade 9 scores, and seven other 
variables, based on responses to the SIB items. These seven variables are; 
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The cases included are those "matched cases" having retest classification code 0 and having valid P*801 values 
valid responses on 1963 SIB items 59 and 156, and also valid responses on the 1963 STB items involved in X—891 
X-892' X-893*, and X-894*. The cases are not weighted. 
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Four variables representing number of high school courses 
in selected subject-matter areas. 



1) X— 891*. No. of mathematics courses (in a college-preparatory 

sequence) taken in grades 9-12 

2) X-892*. No. of physical science courses taken in grades 9-12 

3) X-893*. No. of science courses taken in grades 9-12 

4) X-894*. No. of foreign language courses taken in grades 9-12 



b. 



One variable (from the 1960 SIB) related to home background 

2 



5) P*801. 



Socioeconomic index: based on responses (in grade 9) 

to nine SIB items 



c. 



Two additional 1963 SIB items relating to post-high-school plans 



6) SIB-59. Item on college plans 

7) SIB-156. Item on amount of counseling received from high school 

counselor 



SIB items 59 and 156 are as follows: 
Item 59. 



Do you expect to go to college? 

(4) A. I definitely will go to college. 
I am almost sure to go. 

I am likely to go. 

I am not likely to go. 

I \cill not go to college. 



(3) 

( 2 ) 

( 1 ) 

( 0 ) 



B. 

C. 

D. 

E. 



Item 156. How many times have you discussed your plans for after high 
school with... [the] school counselor? 



(0) 


A. 


None 


(1) 


B. 


One 


(2) 


C. 


Two 


(3) 


D. 


Three 


(4) 


E. 


Four 


(5) 


F. 


Five or 



The numbers in parentheses to the left of the options indicate the "score" 
assigned for each response. 



The four number-of-courses" variables (which are derived from responses to 
18 items in the 1963 SIB) are described in detail in Appendix D-2. 



'The socioeconomic index is described in Appendix E. 
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Subsequent Data Analysis 

Analysis of the six correlation matrices fell Into three phases. The 
first consisted primarily of partial canonical correlation analysis between 
a predictor set of variables — the four "number-of-courses” variables (X-891’ 
to X-894’), college plans (SIB-59), and amount of counseling (SIB-156) — and 
a criterion set of variables, the grade 12 test scores, with a third set of 
variables, the grade 9 test scores, partlaled out. (The same analysis was 
repeated, with socioeconomic Index added to the set of partlaled-out 
variables.) 

The second phase, which was a hy’-product of the first, consisted in 
obtaining part (and partial) correlations of the individual predictor- 
variables with the individual criterion-variables. This vjas supplemented 
by a study of the Intercorrelations among the seven variables derived from 
the SIB, with the grade 9 test scores partlaled out. In this analysis 
particular emphasis was placed on the relation of socioeconomic Index to 
the other six variables based on the SIB (with grade 9 scores partlaled 
out). 

The third phase was multiple correlation analysis, with selected grade 12 
test scores used as criterion variables and with the Independent variables 
added one at a time in a predetermined order. The Independent variables 
(predictor variables) in this phase were the grade 9 scores, the number-of- 
courses variables, college plans, and socioeconomic index. 

The results obtained from these four phases of data analysis will be 
discussed in subsequent sections of this chapter. 

SOME BASIC RESULTS 

The Raw Correlations 



Inspection of the correlation matrices, shown in Appendix J, reveals 
substantial correlations both within and between the three sets of variables 
Included — the grade 9 test scores, the grade 12 test scores, and the other 
variables used for statistical control or for prediction (i.e., socioeconomic 
index, courses taken, college plans, etc.). But this doesn’t tell us much 



about cause and effect, since, as all readers of this report surely know, 
concomitance does not necessarily mean causation. And what we are really 
Interested in is causation. We want some leads as to what factors help 
produce greater increases in some students* scores than might be expected, 
other things being equal, and what factors work in the opposite direction, 
to hinder growth. 

Does taking college-preparatory mathematics courses in high school, for 
instance, improve a student's mastery of elementary school arithmetic? Or 
is it the motivational effect of expecting to go to college that produces 
these gains? Or is it neither of these things but rather the effect of 
greater mathematical aptitude to begin with, which is related both to 
likelihood of going to college and to likelihood of taking college-preparatory 
mathematics courses? The raw correlations don't give us the answers. As a 
matter of fact they present a very complex picture, because of the inter- 
relations among all three kinds of values (grade 9 scores, grade 12 scores, 
and SIB data). 

1 The rest of this chapter, therefore, is devoted to various statistical 

I , 

I analyses that take the raw correlation matrices as their starting point, 

I but go several steps beyond them. The purpose of these further analyses is 

I to see whether it is possible to untangle some of the complex interrelation- 

ships among variables in order to get a clearer understanding of what may 
be happening. 

The Partial Canonical Correlation Analyses 

The set-up of the 12 partial canonical analyses, which were described 
briefly in the preceding section, is summariized in Table 8-2. It will be 
recalled that the grade 12 scores are the criterion set and the grade 9 
scores have been partialed out. Table 8-2 shows exactly what variables are 
^ in each of the three sets (predictor set, criterion set, and partialed-out 

set) in each analysis. As seen from this table, the only difference between 
the six odd-numbered analyses and the six even-numbered ones is that in the 
latter, socioeconomic index has been added to the set of partialed-out 
variables. 
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The six predictor variables are sometimes referred to in this chapter 
as "student action" variables. This is in recognition of the fact that at 
least to a certain extent these six variables represent voluntary actions 
on the part of the student. Whether he plans to go to college is at least 
partly under his control. Whether he takes college-preparatory math, 
physical science, and foreign languages would be largely up to him to 
decide, in many high schools. Even in high schools where taking such courses 
is mandatory for students in the college-'preparatory curriculum, being in that 
curriculum at all is likely to be at least partly a matter of choice. As 
for number of contacts with the high school counselor, while some limited 
number of such meetings may be mandatory, seeking additional assistance j 

beyond the required minimum number of contacts is voluntary. j 

The resulting partial canonical correlations are shown in Table 8-3. 

(The number of canonical correlations resulting from each analysis is equal 
to the number of predictor variables— —six in each case— since there are • 
fewer variables in the predictor set than in the criterion set.)^ Table 8-3 I 

also shows how many of the canonical correlations are significant. 

As in the case of the canonical analyses in Chapter 6, and for essentially j 

the same reasons, no attempt will be made to interpret the canonical variates I 

derived in the present analysis. Again the number of significant canonical 
correlations in each analysis will be regarded as the chief issue. 

The number of significant canonical correlations may be regarded as 
indicating the number of variables (among the set of six predictor variables) 
that can be considered to have a component which is independent of any of 
the other five and at the same time is significantly correlated with a linear 
composite of the criterion variables (grade 12 scores with grade 9 scores 
out). (In geometrical terms this is perhaps somewhat analogous 
to rotating the significant canonical factors obliquely so that each axis 
goes through one of the "significant" predictor variables.) 

Now suppose that n* is the number of significant canonical correlations 
when just the grade 9 scores are partialed out (i.e., partial canonical 



1 



Since the original correlation matrices (AM, AF, DM, DF, EM, and EF) are 
all of full rank, the number of canonical correlations extracted never 
falls below six, in any of the 12 analyses. 
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TABLE 8-3. Partial canonical correlations between set of 
grade 12 scores and 6 predictor variables 
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analysis numbers 1, 3, 5, 7, 9, and 11) and that n’’ is the corresponding 
nu*nber when in addition to the grade 9 scores, socioeconomic index is also 
partialed out (i.e. , partial canonical analysis numbers 2, 4, 6, 8, 10, and 
12), We can expect that n' ' will usually be either equal to n' or 1 less 
than n ' . 

If n" is equal to n' it may be regarded as meaning that if the grade 9 
scores are partialed out there is no significant correlation between socio- 
economic index and the criterion variables (grade 12 scores) after all the i 

criterion variance accounted for by the six original predictor variables J 

has been removed. 

On the other hand if n'' = n* - 1 it means that one of the n predictor 
variables that is independent of the other five and significantly correlated 

the set of criterion scores may owe this correlation solely to the 
socioeconomic component. 

It can be seen from Table 8-3 that corresponding values of n' and n* * I 

are equal in about every case. This is quite consistent with the easily 
observed fact that the differences between corresponding canonical correla- I 

tions in the even-numbered and odd-numbered canonical analyses (i.e., with 
and without socioeconomic index partialed out) are negligible suggesting 
that these differences are in all probability not significant (and that 
whether they are significant or not, they are certainly not sizable enough 
to be important) . 

Thus it would appear that the primary way in which socioeconomic factors 
operate, at least during the high school period, in affecting test scores 
is by affecting certain behaviors — e.g., choice of an academic or a non- 
academic program in high school, choice of specific courses, planning for 
college — which, in turn, have a more direct effect on test scores. i 

Further aspects of this problem, the effects of socioeconomic status on 
scholastic performance, are discussed later in the chapter. 

There are two or three significant canonicals in the Battery A analyses, 
one or two in Battery D, and about two in Battery E. These numbers may be 
regarded as indicators of the number of predictor variables (among the six) 
that are needed in order to account for all of the effective prediction 
provided by any of the six. In subsequent sections of this chapter we shall 
see how the part and partial correlations between individual variables help 
us to gain insight into the nature of the prediction of grade 12 scores and 




the character of the predictors producing it 







The Part Correlations ^ 

Table 8-4 shows part correlations between the variables of the criterion 
set (grade 12 scores) on the one hand and the six variables of the predictor 
set (SlB-based functions) on the other hand, with socioeconomic index and 
the set of grade 9 scores partialed out of the predictor variables. (The 
variables involved in this part-correlation analysis are identical with the 
ones in the even-numbered canonical analyses, described in the previous 
section.) 

The partial correlations corresponding to the part correlations shown 
in Table 8-4 were also obtained. They were used in determining the signif- 
icance levels of the part correlations. The principle used was that if a 
partial correlation coefficient is significantly different from zero, the 

corresponding part correlation may also be inferred to differ significantly 
2 

from zero. (The significance level of the partial correlation was deter- 

3 

mined by means of Fisher’s z transformation.) The resulting significance 
levels of the part correlations are shown in Table 8-4. It will be noted 
that every one of the six predictor variables has significant part correla- 
tions with some of the criterion variables. But many of these significant 
correlations are obviously due to some sort of indirect linkage rather than 
to a direct effect. For instance number of courses in foreign languages has 
a significant part correlation with Mathematics Information (R-106), but it 
hardly seems likely that the student would augment his stock of information 
about mathematics in a language course. Almost certainly the correlation of 
number of language courses with Mathematics Information is due to the fact 
that students in a college-preparatory program are likely to take both 
mathematics and language courses while students in a vocational program are 



Part correxations are discussed in MuttivaTiate Cowetation Andiysis 
(DuBois, 1957) 

2 The reason for this is that part r has the same numerator as partial r, but 
a larger denominator, so that if partial r has a non-zero numerator (in 
the population parameter), part r also does. 

^ The formula used for standard error of z was: 



^ N - n - 3 

where N = number of cases. 

n = number of variables partialed out. 















i 
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TABLE 8-A. 



a t) 

Part correlations between grade 12 test scores (criterion variables) and sl>^ predictor variables 



Retest Grade 12 



MALES 



FEMALES 



Variable 


X-891' 


X-892' 


X-893' 


X-894' 


SIB--59 


SIB-156 


X-891' 


X-892' 


X-893' 


X-894' 


SIB-59 


SIB-156 


R-102 


.022 


.032 


-.033 


-.018 


.046 


.020 


.018 


.013 


-.001 


.065** 


.056* * 


.012 


R-103 


. 085** 


.068* 


.044 


.030 


.134** 


.024 


.059* 


.061* 


.028 


.121** 


120** 


-.007 


R-104 


.018 


.046 


.035 


. 105** 


.071* 


.034 


.047 


.022 


-.024 


.048 


.071** 


.032 


R-105 


.0A5 


.057 


-.033 


.013 


.018 


.015 


.020 


.049 


.034 


.015 


.020 


-.007 


R-106 


.286** 


.253** 


.119** 


.114** 


.205** 


.095** 


. 300** 


.271** 


.137** 


.179** 


.247** 


.104** 


R-107 


.080** 


.179** 


.072** 


.035 


. 092** 


.038 


.098** 


.259** 


.202** 


.021 


.119** 


.049 


R-108 


.068* 


. 149** 


. 104** 


.034 


.056 


-.054 


.032 


.117** 


. 108** 


.041 


.053 


-.006 


R^109 


-.003 


-.034 


-.033 


-.006 


.032 


.012 


-.008 


.011 


-.a8 


-.022 


-.006 


-.025 


R-110 


.028 


-.022 


.006 


-.035 


-.028 


.043 


-.003 


-.021 


-.U)3 


-.104** 


-.032 


-.032 


R-111 


.033 


.096** 


^.002 


-.001 


-.003 


-.015 


.022 


.224** 


.189** 


-.101** 


.061 


.004 


R-112 


-.055 


-.033 


-.026 


-.128** 


-.126** 


-.050 


.015 


.105** 


.065* 


-.040 


-.019 


.009 


R-113 


-.073* 


.026 


.022 


-.015 


-.039 


-.017 


.005 


.058 


.033 


-.010 


-.032 


-.024 


R-llA 


.017 


^.019 


-.024 


.007 


-.034 


.079* 


-.003 


.032 


-.002 


-.068* 


-.050 


-.014 


R-115 


.OAA 


.049 


.047 


.039 


.073* 


.016 


.018 


.065* 


.007 


-.046 


.055 


.037 


R-131 


.025 


.052 


.055 


.030 


.049 


.041 


-.024 


-.025 


-.C46 


.057 


.006 


.014 


R-132 


.OlA 


-.042 


-.056 


-.019 


-.072 


-.009 


-.050 


-.013 


-.041 


.001 


-.011 


-.061 


R-133 


.000 


.083* 


.024 


-.047 


-.003 


-.033 


-.042 


.011 


-.007 


.019 


-.078* 


-.012 


R-13A 


.037 


.033 


-.014 


-.067 


-.024 


-.048 


.010 


.021 


.020 


-.009 


-.055 


-.062 


R-135 


.030 


.057 


.018 


.007 


.066 


.048 


.009 


.073 


.075 


.022 


-.030 


-.015 


R-139 


-.0A3 


-.093* 


-.048 


-.056 


-.008 


-.016 


-.092** 


-.118** 


-.124** 


-.040 


-.042 


-.013 


R-1A2 


.028 


.045 


.045 


-.024 


.104** 


-.026 


.011 


.064* 


.045 


.045 


.051 


-.077** 


R-290 


.078* 


.039 


-.032 


.030 


.030 


.050 


.006 


.060 


-.046 


-.020 


,019 


.035 


R-131 


.078* 


-.026 


.038 


.029 


.061 


.049 


.008 


-.016 


-.013 


.039 


.009 


.010 


R-132 


.0A8 


-.014 


-.044 


-.052 


.023 


.109** 


- . 000 


.054 


.012 


.081* 


.040 


.088* 


R-133 


-.006 


-.018 


.064 


.039 


-.008 


.030 


.032 


-.019 


.083* 


.016 


.005 


-.072* 


R-13A 


-.018 


.016 


.021 


-.034 


-.087* 


.004 


.016 


.066 


.013 


-.025 


.065 


.059 


R-135 


.llA** 


.047 


-.014 


.140** 


.067 


.052 


-.014 


.012 


.002 


.037 


.059 


.028 


R-139 


-.074 


-.011 


-.056 


-.082* 


-.003 


.073 


-.026 


-.018 


.002 


-.048 


-.039 


.019 


R-142 


.042 


-.013 


.003 


.034 


.059* 


.045 


-.002 


.023 


-.003 


-.006 


.043 


.000 


R-212 


.086* 


.008 


-.003 


.060 


.043 


-.027 


-.023 


.017 


.001 


.043 


-.013 


.029 


R-231 


.076* 


.042 


.039 


.020 


.079* 


.017 


-.075* 


-.070* 


-.068* 


.017 


.022 


-.031 


R-232 


.021 


.020 


.039 


.016 


.021 


-.019 


.001 


-.009 


.035 


.032 


.016 


-.002 


R-233 


.069* 


.040 , 


-.018 


-.002 


.084* 


-.059 


.076* 


-.019 


-.011 


.053 


.074* 


.016 


R-234 


.098* 


.071 " 


.042 


.018 


.122** 


.027 


.050 


.021 


-.020 


.054 


.038 


.008 


R-235 


.077 


.100* 


.062 


-.013 


.079 


-.029 


.029 


-.008 


-.033 


.006 


115** 


-.012 


R-290 


.106** 


-.003 


.005 ■ 


-.058 


-.010 


.004 


-.005 


-.020 


-.021 


-.039 


-.051 


.009 


R-311 


.014 


.046 


-.053 


-.040 


.062 


-.002 


.000 


-.002 


.002 


.003 


-.039 


-.003 


R-312 


.262** 


.216** 


.088** 


.098** 


.199** 


.069* 


.318** 


.224** 


.132** 


.100** 


.205** 


.118** 


R-333 


.260** 


.257** 


.111** 


.118** 


.199** 


.032 


.277** 


.238** 


. 142** 


.121** 


.190** 


.066 


R-131 


-.007 


-.036 


.025 


.043 


-.027 


.008 


-.010 


.015 


.021 


.082* 


.089* 


.093* 


R-132 


-.003 


-.061 


-.024 


.069 


.087 


-.047 


.001 


.007 


-.025 


.099* 


.033 


.008 


R-133 


.091 


.038 


.069 


.025 


.085 


.057 


.061 


.096* 


.075 


.082 


.149** 


.022 


R-13A 


.105* 


.126* 


.007 


.106* 


.047 


.014 


.013 


.041 


.016 


.012 


.013 


.072 


R-135 


.018 


.064 


-.013 


.068 


.014 


-.049 


.113** 


.040 


.023 


.108* 


.013 


-.018 


R-139 


-.012 


-.061 


-.059 


.063 


.083 


-.051 


-.061 


-.139** 


-.100* 


-.081 


-.005 


-.066 


R-1A2 


.057 


.005 


-.024 


.069 


.047 


-.018 


.024 


.069* 


.052 


.066 


.045 


.088* 


R-220 


-.096* 


-.002 


.068 


.058 


.021 


-.058 


-.043 


-.056 


-.049 


.085 


-.104* 


-.094* 


R-2A0 


.066 


.123** 


.094* 


.174** 


.251** 


.077* 


.143** 


.105** 


.076* 


.150** 


.121** 


-.001 


R-250 


.075* 


.035 


.065 


.072 


.159** 


.007 


.058 


.080* 


.123** 


.114** 


.076* 


.022 


R-260 


-.009 


.035 


-.011 


.006 


.043 


.007 


.044 


-.015 


.000 


.023 


.013 


.084* 


R-270 


-.022 


.061 


.030 


-.017 


.076 


.046 


.101* 


.067 


.068 


.068 


.089* 


-.002 


R-281 


-.047 


-.036 


-.006 


.009 


.042 


.005 


-.034 


-.063 


-.024 


-.043 


-.017 


-.023 


R-282 


.083 


.031 


.078 


.017 


.056 


.086* 


.107** 


.023 


.025 


.068 


.047 


-.007 


R-290 


.067 


.035 


.003 


.028 


.091* 


.034 


.091* 


.033 


.083* 


.045 


.097* 


.036 



^Based on the same data as the even-numbered partial canonical analyses. See Table 8-2 for details. 

^Grade 9 scores and socioeconomic index have been partialed out of the predictor variables (the column variables). The row 
variables (grade 12 scores) have nothing partialed out. 

*Sign if leant at .05 level 
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Significant at .01 level 




Mitei 



TABLE 8— 5« Part correlations between "student action" variables 

and the residuals on those variables after partialing out 
grade 9 scores and socioeconomic index^ 
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Grade 9 scores and P*801 have been partialed out of the coliimn variables. The row variables have nothing partialed out. 
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more likely to take neither. Table 8-5, which shows the part correlations 
among the six predictor variables, with the grade 9 score variables and 
socioeconomic index partialed out of one side, helps support this supposi- 
tion. The table shows that the correlation between number of math courses 
taken and number of foreign language courses is significant at the .01 
level for three groups of girls (those taking Battery A, the Battery D 
group, and the Battery E group) and for two groups of boys (the Battery A 
and Battery E groups). 

It will be recalled that Table 8-3 indicates the number of significant 
partial canonical correlations but doesn't tell which of the six or seven 
predictor variables account for them. And although we still don't have any 
definite answers on this matter, careful study of Table 8-5 gives us enough 
clues to permit surmises. For instance in Matrix DF, Table 8-4 shows that 
the part correlations of five of the six predictor variables (all except 
SIB-156) with the criterion variable Math III (R-333) are significant at 
the .01 level. But we know (from the values shown for n' ' in Table 8-3) 
that only one of the six can possibly have any causative relationship. And 
it certainly seems more likely that number of math courses taken in grades 
9-12 (X-891'') has an effect on Math III (Advanced High School Mathematics), 
which samples the math taught in grades 10-12, than that X-B92', X-893', or 
X-894' (which represent numbers of courses in other areas) has a direct 
effect on Math III score. And X-891' also seems to be a more likely direct 
explanation than does SIB-59 (college plans). As for the fact that n' 

(in Table 8-3) is 1 greater than n' ' for the Matrix DF canonical correlations 
significant at the .05 level, we know that the additional causative variable 
(at least as far as the seven under consideration are concerned) has to be 
socioeconomic index (P*801). Thus we tentatively conclude that in Matrix 
DF variable X-891' accounts for the single significant canonical correlation 
in canonical analysis //8 and that P*801 accounts for the single additional 
significant canonical correlation that turned up in canonical analysis //7. 
This leaves us with a question as to the source of the significant part 
correlations of R-333 with X-892', X-893', X-894', and SIB-59. Table 8-5 
provides the answer. All four of these other variables correlated with R-333 
also have sizable part correlations (significant at the .01 level) with 
X-891'. It seems likely, although the actual computation that would be 
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required for the purpose has not been completed,^ that if X-891- were 
partialed out the correlations of X-892’, X-893’, X-894’, and SIB-59 with 
R-333 would no longer be significant. 

Similar reasoning can be applied to the other five correlation matrices 
(AM, AF, DM, EM, and EF) , and surmises can be made in a similar way concern- 
ing the predictor variables accounting for the significant canonical relation- 
ships. Although for some of these other matrices the situation is not so 
clear-cut and the surmises on not quite so solid a basis as for Matrix DF, 
they represent our best hunches compatible with the data. These hunches 
are summarized in Table 8-6. (The number of significant predictor variables 
has been determined precisely. It is only their specific identity that is 
based on surmise.) 

Stepwise Multiple Correlation Analysis 

In an attempt to determine the extent to which various factors account 
for performance in grade 12 on individual tests, stepwise multiple regression 
analysis was undertaken. 

Procedure . The procedure used involved adding predictor variables 
(grade 9 test scores, amounts of course work taken in various subject- 
matter areas, college plans, and socioeconomic index) either in groups or 
individually, but always in a predetermined order . (This is important 
because it means that the disadvantages of the more usual type of stepwise 
analysis are avoided. In the usual stepwise analysis the order in which 
predictor variables are added is determined by the data in such a way as 
to maximize the initial correlation and the Increments to the multiple R 
at each step — a procedure which, unlike the procedure reported on here, 
capitalizes on random variance.) 



^Further analyses of this sort have been planned and preliminary work on 
them is in progress. Their purpose is to attempt to determine a little 
more definitely the causative relationships accounting for canonical and 
other correlations involved in the six matrices of Appendix J. The results 
will be presented in a future report. 
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TABLE 8-6. Predictor variables that probably account for 
the significant partial canonical correlations 
shown in Table 8-3 



Predictor variable 





Matrix- 


-►AM 


AF 


DM 


DF 


EM 


X-891 ' 


No. of coll. -prep* math courses 


kk 


** 


kk 


kk 




X-892' 


No. of physical science courses 


kk 


kk 






mm 


X-893' 


No. of science courses 






•w 


wm 




X-894 ' 


No. of foreign language courses 


" 1 


i 






kk 


SIB-59 


Plans for college 


1 


1 

k 




_ 


k 


SIB-156 


Amount of counseling in h.s. 


- 


- 




- 


— 


P*801 


Socioeconomic Index 


- 


- 


- 


k 


- 


Number of 


significant canonical r's j 1 n' 


3 


2-3 


2 


1-2 


1-2 


(Transferred from Table 8-3)^ j ( 


3 


2-3 


2 


1 


1-2 



EF 



** 

irk 

k 



2-3 

2 



The word "probably” is underlined in the title to stress that definite identi- 
fication of predictor variables bearing a causative relationship to the 

variables (grade 12 scores) is not entirely possible at this stage. 

V/here two values are shown for n' or n" for a matrix, the lower number 
represents the number of partial canonical correlations significant at the 
.01 level and the higher number represents those significant at the .05 level. 

f 

The indicated predictor variable can be regarded as probably accounting for one 
of the Table 8-3 partial canonical correlations significant at the .01 level. 



The Indicated predictor variable can be regarded as probably accounting for a 
Table 8-3 partial canonical correlation that is significant at the .05 level 
but not at the ^01 level. 



Fourteen criterion variables (grade 12 test score variables) were 
selected for inclusion in this analysis. The order in which the predictor 
variables were introduced into the multiple regression was as follows. 

The first predictor introduced was grade 9 Abstract Reasoning (R-290) 

(except for the analysis in which grade 12 Abstract Reasoning was the 
criterion). The reason for this was to eliminate at the start as much of 
the effects of those aspects of general ability that are at least relatively 
independent of what happens in high school as seemed possible with a single 
test. (It will be recalled that Abstract Reasoning was the only test 
available for this purpose for all the stepwise analyses, since it was the 
only test included in all six retest batteries.) After Abstract Reasoning, 
the remaining grade 9 variables were introduced, the last one to be introduced 
being, in each case, the ninth-grade variable correspondiing to the grade 12 
criterion variable. Then whichever one of the four number-of-courses 
variables (X-891*, X-892*, X-893*, or X-894*) seemed most relevant was 
added; then the college-plans variable (SIB-59); and finally socioeconomic 
index (P*801) . 

Results . The results are summarized in Table 8-7. The 14 criterion 
variables are listed in the column at the left. The table shows the multiple 
correlation at each stage and also the part r between the last predictor 
variable (or set of them) added and the criterion variable, with preceding 
predictor variables partialed out of the last one. (The sum of the squares 
of the part correlations equals the square of the multiple correlation.) 

Looking at the right-hand column of Table 8-7, we see from the part 
correlations that socioeconomic index makes hardly any contribution to the 
prediction of the criterion score after the effects of all the other predictors 
have been removed. Only one of the 28 part r*s (the one with the R-107 
criterion, for males) is substantial (and that one, somewhat surprisingly, 
is negative: -.26). 

Likewise, planning to go to college does not appear to have any 
spectacular effect on twelfth-grade score — aside from whatever effects it 
may have as a motivating factor in causing the student to take more college- 
preparatory courses (math, etc.), or perhaps merely to enroll in a college- 
preparatory curriculum in which such courses are mandatory. Even those 
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TABLE 6-T* Multiple R's and part r's for prediction of selected I963 (Grade 12) scores 
from i960 (Greide 9) scores, number of courses taken in a related area, 
college plans, and amount of counseling received 



Table 8-7, Section 1. Based on cases in retest matrices AM (Males, N-U19) and AP (Females, N=493) 

In this section the criterion variables are selected information scores 



Criterion 

variable 

1963 

(Grade 12) 
test score 



Sex 



Predictors 



i R-102 Vocab. I 



Mult. R* 
Part r** 



Predictors 



R-106 Math Info. 



Mult. R'f* 
Part T** 



Predictor variables, listed in order of inclusion (from left to right) in multiple R 
1960 ^Grade 9) test scores 



Abst 

Reas 



Scores on miscelleineous tests*** 



i960 

score 



No, of 
courses 



corresp.in rel- 
to crit- evEuat 



M 

F 



R-3 








Scr. 


*** 


Sc. At 


hitit 


Info . II 


R290 


RlOl 


R104-108 


RIO9 


RllO-115 


RI92 


4871 


•5350 


.8038 


.8072 


.8251 


.8311 


.5398 


.5468 


.7956 


.8042 


.3085 


.8390 


.4871 


.2213 


.5999 


.0740 


.1709 


.0997 


.5398 


.0872 


.5779 


.1173 


.0833 


.2242 




Scr. 


Voc.I 


A** 




Inf. II 


R290 


RlOl 


R102 


R103-105, 108-115 


R192 


•5457 


.5759 


.7179 


.7677 




.5101 


.5165 


.6664 


.7326 


.7348 


.5457 


.i 84 o 


.4286 


.2720 


.0775 


.5101 


.0811 


.4211 


.3043 


.0568 



[erlon 



Lit. 

RI03 



.8332 

. 81^07 



.0591 

.053*^ 



Phy.Sc 

RI07 



.7784 

.7369 



.1027 

.0556 









Scr. 


Voc. 




Aero 


Sci. 


Mech 


Bio. 


Math I 


Slec 


Engn 


Phys 


Phys 














I 


*** 






Att. 














Sci. 


Sci. 






Predictori 


3 


R 29 O 


RlOl 


R 102 


RI 03-105 


RllO 


RIO 9 


R 112 


RIO 8 


RIO 6 I 


mi 


RI 34 


RI 07 


5 ^ 2 ' 


SIB 59 


P *801 


Physical 










113-115 




























Science 










192 




























Mult. R* 


M 


•5125 


5448 


.7422 


.7914 


.7988 


.7991 


.7994 


.8033 


.8125 J 


3 l 60 


.8163 ■ 


•8398 


•8592 


.8596 


•8969 




F 


.4849 


4872 


.6964 


.7418 


.7430 


.7450 


.7469 


.7548 


.7590 .’ 


r 639 


. 7639 . 


.7890 


.8307 


.8319 


.8320 


P 6 U*t r'H* 


M 


•5125 


1848 


• 504 o 


.2747 


,1085 


;0219 


-.0219 


JO 791 


.1219 


3755 


;0221 . 


•1973 


.1816 


.0262 


t 2560 




F 


.4849 


0473 


.4976 


•2555 


,o 422 


.0546 


.0532 


J .089 


•0797 J 


3864 


• 0000 , 


.1974 


•2599 


M 47 


.0129 








Scr. 


Voc.] 


*** 




Sci.At 




*** 


Inf. II 


Phy.Sc. 


Biol. 


Sci. 






Predictors 


3 — > 


R 290 


RlOl 


R 102 


R 103-106 


RIO 9 


RllO -115 


RI 92 


RI 07 


RIO 8 


x 8 ) 93 ' 


SIB 59 


P *801 


Biological 

Science Mult. R* 


M 


•4059 


4222 


.6225 


.6659 




.6670 


.7056 


.7152 


•7269 


.7606 


.7678 


.7680 


•7729 


Info. 


F 


.3941 


3970 


.5943 


.6436 




•6463 


•6639 


.6663 


•6681 


.7122 


.7200 


.7224 


.7235 


Part r*** 


M 


•4059 


J.I 62 


■4574 


•2365 




•0383 


.2302 


.1168 


•1299 


.2239 


.1049 


.0175 


,0869 




F 


•3941 


.0479 


.4422 


.2470 




.0590 


.1519 


.0565 


.0490 


.2467 


•1057 


.0588 


.0399 








Scr. 


Voc.] 


*** 






*** 




Infill 


Biol. 


Phy . Sc . 


Sci.At 


Phy.Sc. 






Predictor 


3 


R 290 


RlOl 


R 102 


R 103 - 106 , 


RllO -112 


RI 92 


RIO 8 


RI 07 


RIO 9 


X 892 ' 


SIB 59 


P* 80 l 


Scientific 










113-115 


























Attitude Mult. R* 


M 


•3761 


4177 


.5439 


•5774 






.5827 




.5869 


.5901 


• 5930 


•6703 


.6711 


.6745 


.6760 




F 


.3911 


.4005 


•5098 


.5442 






.5455 




.5578 


.5602 


.5602 


.6071 


.6077 


.6078 


.6113 


Part r** 


M 


•3761 


J .817 


.3484 


.1938 






.0784 




.0701 


• 06 l 4 


•0586 


.3125 


,0328 


.0676 


.0450 




F 


•3911 


.0863 


.3154 


.1904 






-.0376 


.1165 


.0518 


.0000 


.2340 


.0270 


mio 


.0653 








Scr. 


Voc. 


*** 


Inf. 


Bio. 


Sci. 


Matt 


i Aero 


Mech 


Fhys 


. Elec 


Phy.Sc. 














I 


RI 93-105 


, II 




Att. 








Sci. 










Predictors •-> 


R 290 


RlOl 


R 102 


1 ] 3-115 


RI 92 


RIO 8 


1 RIO 9 


R 108 


) RllO 


R 112 


RI 07 


Rill 


X 892 ' 


SIB 59 


P* 80 l 


Electricity ^ 


M 


• 44 iO 


.4534 


.6238 


.6718 


.6838 


.6849 


1.6849 


.6887 


.7212 


.7548 


.7779 


.7955 


.8017 


.8025 


.8029 


and Elec- 
tronics 


F 


•2740 


^759 


j ^474 


•5132 


.5133 


.5249 


' .5251 


• 525 : 


1 .5257 


.5357 


.5496 


' .5897 


.6308 


.6311 


.6321 


Info. Part r^w* 


M 


• 44 io 


•1053 


•4284 


.2494 


•1275 


•0388 


1 .0000 


.0722 


’ . 2 i 4 i 


.2227 


’ .1882 


1 .1664 


•0995 


-.0358 


-0253 




F 


.2740 


0323 


.3522 


.2514 


jOIOI 


•1097 


' .0145 


' -. 014 ; 


5 .0205 


•103c 


1 .1228 


i .2137 


•2240 


-PI95 


-9355 



Voc.I 

R102 



8443 

8548 



1365 

1546 



area 



For. Lang 
1894' 



.8444 

.8584 



College Socio- 



plans 

(1963) 

.SIB59 



SIB59 



.8469 

.8599 



-.0130 

.0785 



Math 

RIO6 



8016 

7783 



1915 

2505 



Math 

X891' 



.8557 

.8405 



.2994 

• 3173 



.0650 

;0508 



SIB59 



.8669 

.8560 



economic 

(i960) 



P*801 



•8475 

.8603 



.0319 

.0262 



P*80l 



8669 

'.8566 



1389 

.1622 



.0000 

.0321 



o 

ERIC 









TABLE 8-7. Section 2 . Based on cases in retest matrices DM (Males, N= 4 ll) and DP (Females, N= 493 ) 



In this section the criterion variables are selected 
"antitude" and "achievement" scores 



Criterion 

variable 

1963 

(Grade 12 ) 
test score 



Sex 



R -212 Memory 
for 
Words 



Predictors 
Mult. R* 

Part r'*** 



Predictor variables, listed in order of inclusion (from left to right) in multiple R 







i960 (Grade 9 ) 


test scores 






























i960 K 






















score c 


Abst. 




Scores on miscellaneous 


tests*** 




1 


Gorresp i 1 


Reas. 




















to a 




















1 


crit . 




Math. 


Math 


Math 


Info 


Spell 


Cap 


Pune t 


Isage 


Expr 


I 




I 


II 


III 


II 














R29O 


R 311 


R 312 


R 333 


RI92 


R 231 


R 232 


R 233 


R 234 


R 235 


R 212 


.2696 


.3425 


.3467 


.3473 


.3958 


. 4 o 44 


. 4 l 80 


,4208 , 


,4242 


4308 , 


5724 


JII8 


.4016 


.4490 


.4512 


.5416 


.5481 


.5502 


.5580 


.5631 


.5631 . 


6367 


£696 


£112 


.0538 


,0204 


.1898 


.0830 


.1058 


.0485 ■ 


1O536 


0751 . 


3769 


.3118 


.2531 


£008 


.0445 


.2996 


.0842 


.0480 


P 930 


■0756 


0000 


2972 




Math 




Info 


Mem. 


Spell 


Cap 


Pune 


Jsage 


Expr 


1 




I 


■k**t 


II 


Wds. 














R 290 


R 311 


R 312 , 


RI92 


R 212 


R 231 


R 2.32 


R 233 


R 234 


R 235 








R 333 


















.3553 


.5033 


.5825 


.6343 


.6368 


.6940 


.7051 


.7374 


.7394 


.7422 




.4542 


.5910 


.6668 


.7382 


.7438 


.7728 


.7820 


£196 


.8254 


£310 




.3553 


.3565 


.2932 


.2511 


.0564 


.2759 


.1246 


£159 


,0543 


X )644 




4542 


3781 


.3088 


.3167 


.0911 


.2082 


.1222 


£454 


.0977 


0963 






Math 


Math 


Math 


Info 


Mem. 


Spei: 


L Cap 


Usag( 


3 Expr 


Punct. 




I 


II 


III 


II 


Wds. 












> R290 


R 311 


R 312 


R 333 


RI92 


R 212 


R 231 


R 232 


R 234 


R 235 


R 233 


4072 


.5710 


.6065 


.6086 


.6388 


.6389 


•6649 


.6757 


.6803 


•6849 


.7286 


.4720 


.5811 


.6298 


.6300 


.6671 


.6686 


.6817 


.6901 


.6966 


.7010 


.7544 


.4072 


.4003 


.2045 


70505 


.1941 


.0113 


.i 84 i 


.1203 


JO79O 


.0792 


.2485 


4720 


.3390 


.2428 


-0159 


.2194 


.0448 


.1330 


.1073 


.0949 


.0784 


.2788 




Math 


Math 


Math 


Info 


Mem. 


Spel 


1 Cap 


Pune 


t Expr 


Usage 




I 


II 


III 


II 


Wds. 












► R 290 


R 311 


R 312 


R 333 


RI92 


R 212 


R 231 


R 23 £ 


R 233 


R 235 


R 234 


1 £447 


.3758 


.4203 


.4253 


.5024 


.5027 


.5224 


.5225 


.5543 


.5582 


.5760 


' .3715 


.4764 


.5369 


.5408 


.5852 


.5982 


.6062 


.6136 


•6338 


•6373 


.6667 


I .2447 


.2852 


.1882 


,0650 


.2674 


.0174 


.1421 


. 010 £ 


! .1850 


•0659 


.1421 


' 3715 


.2982 


.2476 


,0648 


.2236 


.1240 


.0982 


.0963 


.1580 


.0667 


.1958 



X894' 

.5752 

.6375 

.0567 

.0319 



Coll. 

plans 

(1963) 

SIB 59 


Socio- 

ec. 

(i960) 


SIB 59 


P *801 


.5761 

.6377 


.5790 

.6377 


.0322 

,0160 


-.0579 

.0000 


SIB 59 


P #801 


.7537 

.8339 


.7542 

.8343 


.1248 

.0591 


.0275 

-J0258 


SIB 59 


P* 80 l 


.7372 

.7569 


.7376 

.7577 


.1083 

.0492 


.0243 

,0348 


5 




SIB 59 


P* 80 l 


.5921 

.6672 


.5929 

.6726 


•1307 

•0200 


,0308 

,0851 



R-2,30 English 
Total 



Predictors -> 
Mult. R* 



Part 



M 

P 



R-233 Punctuation 



Predictors 
Mult. R* 



Part r**t 



R-234 English 
Usage 



Predictors 
Mult. R* 

Part r^H* 



X894' 

.7433 

.8318 

jo4o4 

.0365 



X894' 

.7292 

.7553 

.0296 

P 369 



x 394 ' 

•5775 

•6669 

. 04 i 6 

JO163 



O 

ERIC 



TABtiE 8-7^ Section 2 (continued) 



Criterion 



Predictor variables, listed in order of inclusion (from left to right) in multiple R 



variable 

1963 

(Grade 12) 
test score 


Sex 






i960 (Grade 9) test 


scores 








No. of 
courses 
.in relf 
area 


Coll. 

plans 

(1963) 

SIB59 


Socio- 

(i960) 


Abst. 
Reas . 


Scores on miscellaneous tests 


i960 

score 

corresp 

to 

crit . 








Info II 


Mem.Wds. 


Eng.'iHf-if 


MathI 


Mathll 


Mathlll 




Whth 






Predictors 


R29O 


RI92 


R212 


R231-235 


R311 


R312 


R333 




a 391' 


SIB59 


P*80i 


R-311 Math I 


























Arithmetic Mult R* 


M 


.3866 


.5665 


.5750 


.6331 


.7165 


.7178 


.7184 




.7186 


.7231 


.7241 


Reasoning 


P 


.4714 


.6248 


.6292 


.6765 


.7269 


.7335 


.7335 




.7339 


.7339 


.7-400 


Part r** 


M 


.3866 


.4l4i 


.0985 


.2649 


.3355 


.0432 


-.0294 




.0170 


.0805 


.0380 




P 


.4714 


.4101 


.0743 


.2485 


.2660 


.0982 


.0000 




.0242 


.0000 


.0948 








InfoII 


Mem.Wds. 


Eng.*** 


MathI 


Mathll 


Mathlll 




Math 






Predictori 


3 -> 


R290 


RI92 


R212 


R23I-235 


R311 


R312 


R333 




X891' 


SIB59 


p*80i 


R-312 Math II 


























Introd. Mult. R* 


M 


.3968 


.5518 


.5732 


.6532 


•6952 


.7217 


.7219 




.7712 


.7845 


.7847 


h.s. math 


P 


.4676 


.6266 


.6462 


.6856 


.7037 


.7331 


.7334 




.8080 


.8170 


.8172 


Part r** 


M 


.3968 


.3834 


.1552 


.3132 


.2380 


.1938 


-0170 




.2713 


.1438 


.0177 




P 


.4676 


.4171 


.1579 


.2291 


.1586 


.2055 


.0210 




.3391 


.1209 


.0181 








InfoII 


Mem.Wds . 


Eng.*** 


MathI 


Mathll 


Mathlll 




Math 






Predictors — ^ 


R290 


RI92 


R212 


R231-235 


R311 


R312 


R333 




X89I' 


SIB59 


P*80i 


R-333 Math III 


























Adveinced Mult. R* 


M 


.3275 


.4996 


.5049 


.5933 


.6229 


•6455 


.6473 




.7002 


.7146 


.7151 


h.s. math 


P 


.3705 


■ .5159 


.5353 


.5642 


.5810 


.6013 


.6052 




.6711 


.6808 


.6812 


Part r"*^ 


M 


.3275 


.3773 


.0730 


.3116 


.1897 


.1693 


.0482 




.2670 


.1427 


.0267 




P 


.3705 


.3590 


.1428 


.1783 


.1387 


.1549 


.0686 




.2900 


.1145 


.0233 








InfoII 


Mem.Wds . 


Eng.*** 


MathI 


Mathll 


Mathlll 




Math 






Predictors 




RI92 


R212 


R231-235 


R311 


R312 


R333 


R290 


X891' 


SIB59 


P*80l 


R-290 Abstract 


























Reasoning Mult. R* 


M 




.3632 


.3657 


.4466 


.4626 


.4701 


.4720 


•6016 


.6094 


•6094 


•6133 




P 




.4890 


.5007 


.5525 


.5650 


.5774 


.5786 


.6617 


•6617 


.6632 


.6653 


Part 


M 




.3632 


.0427 


.2563 


.1206 


.0836 


-.0423 


.3730 


.0972 


.0000 


.0691 




P 




.4890 


.1076 


•2336 


.1182 


.1190 


-.0372 


.3210 


.0000 


-o446 


.0528 



Multiple R of criterion with predictor(s) designated above it and all predictors to the left of it, in the predictor row. 






r between criterion and part of the specified predictor. (All preceding predictors are partialed out.) 



V v-W 
n A 7> 



Part r*s shown for a combination of two or more predictor variables apply to a weighted sum of the predictor variables 
concerned. The weights used for this purpose are beta weights corresponding to the multiple R based on all predictor 
variables up to and including the ones in the combination. 
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part correlations for college plans that are large enough to be significant 
are still quite lew, the largest one in Table 8-7 being only about .16. 

As for "number of courses in relevant area," here we begin to observe 
some sizable part correlations. The largest are for number of math courses 
(with R-106, R-312, and R-333) and number of physical science courses 
(with R-107 and, for the girls, with R-111). The correlation with R-111 
(Electricity and Electronics Information) for the girls is probably due to 
the fact that girls tend not to know anything about electricity and electronics 
except what they may learn in the physics course if they happen to take it. 

The correlation of number of math courses with Math I, Arithmetic 
Reasoning (R-311), was negligible, unlike the correlations with the other 
math variables (Math Information, Math II, and Math III). This, of course, 
is quite in line with what was to be expected since the type of skill covered 
by the Arithmetic Reasoning test is not taught at the high school level 
in college-preparatory math courses. If it is mastered at all it is usually 
mastered before that time. But even though the present finding that taking 
mathematics courses in high school does not improve one’s mastery of pre- 
high-school mathematics (R-111) is hardly surprising, it is nonetheless 
noteworthy, in view of the fact that if the effects of mastery on entering 
high school (i.e., grade 9 score) had not been eliminated statistically, 
quite an opposite conclusion might have been reached. 

As for number of foreign language courses taken, it apparently has 
no effect on performance on the English test as a whole (R— 230) nor on 
those specific parts of it that it would be most likely to affect (Punctuation 
and English Usage), if it had an effect on any. Nor does it affect 
performance on the Memory for Words test (R— 212) • Since that test measures 
one aspect of aptitude for learning foreign languages it is interesting to 
note that the relationship is apparently not a reciprocal one. Studying 
foreign languages, which generally includes some memorization of foreign 
vocabulary, apparently does not, in itself, improve one’s ability to do this 
sort of memorizing — or at any rate it doesn’t improve ability to do short- 
term memorizing, the type measured by the test. 

The results discussed in the two preceding paragraphs suggest that 
insofar as it is possible to distinguish between "aptitude measures" and 
"achievement measures," the Arithmetic Reasoning and Memory for Words tests 
fall in the former category. 
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Continuing on our backward (right to left) journey through Table 8 - 7 , 
we note from the part correlations that in just about every case grade 9 
ability in a particular area makes a very substantial contribution to grade 
12 ability in the same area. 

Abstract Reasoning (R-290) , too, makes a very substantial contribution 
to the prediction of scores on every grade 12 test variable. The same 
thing is true of Vocabulary I (R-102), which has a substantial part correla- 
tion with every criterion variable for which the correlation was obtained 
(i.e., R-106, R-107, R-108, R-109, R-111). These two variables, Abstract 
Reasoning and Vocabulary I, together account for much of the general ability 
factor entering into the various grade 12 scores. 

THE ROLE OF VARIOUS FACTORS ; CAUSE AND EFFECT 
The Role of Socioeconomic Index 

As has already been noted in the discussion of the partial canonical 
coi^i^slstion analyses earlier in this chapter, whether socioeconomic status 
was among the variables partialed out made little or no difference in the 
results. Thus it would appear from these results that a major way in which 
socioeconomic factors affect high school achievement is by affecting other 
factors (aptitude levels, kinds of courses taken in high school, etc.) that 
in turn affect achievement more directly. Investigation of this point is 
pushed a bit further in the data of Table 8-7, in which the magnitude of 
the direct effects of socioeconomics factors on high school achievement is 
expressed in numerical terms, as correlation coefficients, so that we can 
see clearly just how small these direct effects are. More specifically, 
the part correlations in the last column of that table show the direct 
effect of socioeconomic factors on achievement after the effects of aptitude 
and achievement levels in the ninth grade have already been taken into 



This term, "general ability factor," is being used here in a somewhat 
different sense from its use in Chapter 6 to describe Factor (VERBL). 

In the present chapter it is used in a non— factor— analytic sense, to 
represent a composite, not a single unitary trait. 
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account — in other words "partialed out" of the socioeconomic variable. The 
college plans variable has also been partialed out, to help clarify the 
direct effects of the socioeconomic variable. After the effects of these 
various causative (or possibly causative) factors — grade 9 aptitude and 
achievement levels, courses taken in high school, and college plans — have 
been eliminated from the socioeconomic variable statistically, the part 
correlations of the residuals with grade 12 test scores are negligible. 

There is no intention here to depreciate the very real handicaps that 
a severely disadvantaged background can impose on a boy or girl, or the 
benefits that a good environment can produce. But it is clear that whatever 
effects background has on school achievement don't wait until the high school 
years to manifest themselves. Rather they are reflected in the scores the 
student obtains at the beginning of his high school career, in grade 9. 

At least insofar as achievement of the types measured by the TALENT tests 
undpr consideration is concerned, whatever direct effects socioeconomic 
background has on achievement develop before grade 9. The damage of a poor 
environment has already occurred by then or the extent of the benefits to 
be derived from a good one has already been established. After that point, 
during the period covered by the present study, the ninth-to-twelf th-grade 
interval, the role of socioeconomic level as a causative agent, insofar as 
it has a role, is indirect , operating on achievement partly through the 
medium of the effects of past achievement. Here the word "achievement" is 
being used broadly to encompass not only the so-called "achievement tests" 
but also the level achieved on the "aptitude" tests since ninth-grade 
achievement on both kinds of instruments determines aptitude for subsequent 
achievement. 

Another indirect way in which socioeconomic background operates is in 
affecting the kind of program a student takes in high school — for instance 
whether he elects foreign language courses, mathematics courses, and other 
college-preparatory work — and his plans, if any, for a career and for further 
education after high school — for instance whether he plans to go to college. 
The part correlations in Table 8-8 suggest that such effects do exist. Even 
after the effects of initial ability level (grade 9 test scores) have been 
partialed out of socioeconomic index, it still has significant correlations 
with college plans and with number of foreign language courses, and (at 






TABLE 8~8. Part correlations showing relation between socioeconomic index residual 
(after partialing out grade 9 test scores) and "student actions" 







Part r with 


P*801 residual 






Males 


Females 




Student action 


A D E 


A D E 


X-891* 
X-892 * 
X-893* 
X-894* 


No. of math courses 

No. of physical science courses 

No. of science courses 

No. of foreign language courses 


.091 .073 .090 

.103t .067 .084 

.002 .081 .059 

.156* .225* .228* 


.154* .174* .171* 
.099t .159* .161* 
.079 .037 .094 

.277* .295* .222* 


SIB-59 

SIB-156 


College plans 
Amount of counseling 


.231* .308* .193* 
.136* .058 .073 


.277* .311* .244* 
.076 .225* .201* 



3i 

Based on the six correlation matrices indicated in Table 8-1. 



Significant at .01 level 

+ 

Significant at .05 level 
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least for girls) with number of math courses and physical science courses. 
There is also some evidence that students in the lower brackets on socio- 
economic status tend to have fewer contacts with a school counselor than 
their more privileged compeers. Whether this is because students not planning 
to enter college are less likely to seek such contacts or because counselors 
are less likely to be available in the schools such students are likely to 
attend is not entirely clear. 

The Role of ’’Student Actions” 

Plans for College . Is planning to go to college accompanied by greater 
motivation toward achievement in high school? The answer is not entirely 
clear. Table 8-4 shows that even after initial ability (as represented by 
grade 9 scores) and socioeconomic index (P*801) have been partlaled out a 
significant relationship remains between whether a student plans to go to 
college and his or her achievement in subjects Included in a college- 
preparatory curriculum in high school (literature, mathematics, physical 
science, English, etc.). But does this better achievement represent the 
results of greater motivation and harder work or does it represent mere 
exposure to courses? There is some evidence that the latter may be the case. 
If planning to go to college has any motivating effects they are apparently 
manifested primarily in choice of courses — insofar as the student has any 
option. (Students planning to go to college presumably are more motivated 
to take college-preparatory courses than are their non-college-bound 
classmates.) As has already been noted, the partial correlations of college 
plans with grade 12 scores are negligible on the whole after number of 
courses in a relevant subject-matter area is added to the variables partlaled 
out. This suggests — and Table 8-5 confirms — that the part correlations 
between college plans and number of courses in various areas (after grade 9 
scores have been partlaled out) are substantial. All these correlations are 
significant at the .01 level. Since there is obviously some confounding of 
the corjitse-taklng variance and the college-plans variance it is not clear 
whether one or the other or both are causing the better grade 12 scores. 

It seems likely, however, that course-taking is responsible for at least a 
part of the effect, and probably for most, if not all, of it. Some evidence 
in support of this is provided by the significant negative part correlation 



o 







in Table 8-4 between college plans (SlB-59) and grade 12 Mechanical 
Information (R-112), for the boys. This negative correlation is probably 
due to the fact that boys not planning to go to college are far more likely 
than the college-bound to be in vocational curricula, and taking shop courses. 

Courses Taken in High School . As has already been suggested, there is 
considerable evidence pointing towards the effects of course work on changes 
in test scores between grades 9 and 12. Table 8-4, supplemented by Tables 
8-7 and 8-5, provides the best evidence. In brief, taking math courses in 
high school Improves the student's performance on Mathematics Information, 
Math II, and Math III (R-106, R-312, and R-333), but not on Arithmetic 
Reasoning (R-311); taking courses in physical science improves performance 
on the Physical Science Information test (R-107), and also, perhaps, on 
Biological Science Information (R-108); and studying foreign languages 
Improves performance on the Word Functions in Sentences test (R-240). 

The correlation of Word Functions in Sentences with number of foreign 

language courses is particularly interesting because Word Functions in 

Sentences is a measure of aptitude for foreign languages.^ Specifically, 

what it measures is knowledge of formal grammar or, in the absence of such 

knowledge, aptitude for learning grammar. Thus it appears that study of 

foreign languages helps students learn something about English grammar. 

Some transfer of training seems to occur. Whether this tends to be true in 

all schools or only in those where the curriculum in English places little or 

2 

no stress on grammar is not apparent from the available data. (The signifi- 
cant partial correlations of Word Functions in Sentences with courses in 
other areas — science and math — are probably the result of the correlation 
of number of courses in these areas with number of foreign language courses.) 



^Thls test was modeled on one of the sub tests in Carroll and Sapon's Pat- 
Lambda Foreign Language Aptitude Battery (1955). 

2 

At least one other investigator, Skelton, has had somewhat similar findings 
based on entirely different Instruments and samples (Skelton, 1958). 
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Also noteworthy is the positive part correlation, low but significant, 
between number of math courses and Visualization in Three Dimensions (R-282), 
for the girls. This correlation helps confirm the notion, alluded to in 
the footnote on page 6-24, that students who have good knowledge of geometry 
in particular, may solve visualization problems geometrically rather than 
through a global type of visualization. 

As for significant negative correlations, the part correlations of 
foreign language courses with aerospace information (R-110) and with 
electrical information (R-111) are negative for the girls, while the boys' 
correlation between foreign language courses and Mechanical Information 
(R-112) is also negative. Number of courses taken by the girls in math 
and science are also negatively correlated with Accounting, Business, and 
Sales Information (R-139). Most Of these negative correlations probably 
reflect the effects of a vocational curriculum in raising scores on Mechanical 
Information, and the effects of a business curriculum in raising scores on 
Accounting, Business, and Sales Information. 

Amount of Counseling in High School . Most of the part correlations with j 

amount of counseling (SIB-156) in Table 8-4 are negligible. One of the few j 

significant relationships that shows up for both sexes is with scores on 
Math Information (R-106) and Math II (R-312). Perhaps this is a result of 
the fact that the more counseling a student receives the more likely he is 
to take math courses in high school. (Perhaps that is the gist of the 
counseling he receives.) As a matter of fact, as Table 8-5 shows, amount 
of counseling is associated in a positive direction with course-taking in 
math, physical science, and foreign languages (all college-preparatory 
subjects), and with planning to attend college. Again, no causal relation- 
ship can be established definitely in either direction. Counseling contacts 
may be either ,:3i result or a cause (or both, in part) of plans to attend 
college. 



The Role of Aptitude 



We have considered the roles of socioeconomic status, college plans, 
courses taken, and counseling received in determining grade 12 achievement 
levels as measured by tests. These several factors turn out to be of 
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varying importance — but far outweighing any of them in its effect is 
’’initial aptitude” (as indicated by grade 9 test scores). Table 8-7 provides 
ample evidence of the major role played by ability as measured at grade 9, 
in the prediction of grade 12 test scores. 

Of course there is no reason to think that aptitude as of grade 9 is 
necessarily Independent of socioeconomic status. It probably isn’t. After 
all environmental factors had been acting on the individual for lA or 15 
years at the time the grade 9 measurements were made, and it would be strange 
If they had had no effect at all, In all that time. Nevertheless, however 
the ability level existing at age 14 or 15 may have developed, aptitude 
measurements made at grade 9 more truly represent ability (or aptitude at 
that time) than would measurements of ’’native ability,” made at birth If that 
were possible, or In Infancy. This does not mean that environmental factors 
as typified by socioeconomic status can have no effect beyond grade 9. 

They can, of course. But their overall direct effect Independent of aptitude 
does seem to be slight on the whole, during the high school years. 



APTITUDE VERSUS ACHIEVEMENT ; A NEW VIEWPOINT 

Can measures of aptitude be distinguished from measures of achievement? 
This Is a problem that we have touched on earlier in this report— first In 
Chapter 5 and then again In Chapter 7. The object was to determine whether 
certain tests were functioning as measures of invariant or nearly invariant 
abilities called ’’aptitudes” and other tests as measures of somewhat more 
malleable abilities referred to as kinds of ’’achievement.” But the data 
In these earlier chapters turned out to provide no sound basis for making this 
distinction. In the present chapter, however, we do find some evidence of 
the type sought. Certain variables in the TALENT battery seem to function 
as aptitude measures and others as achievement measures. The evidence is 
found chiefly In Table 8-4, supplemented by Table 8-7. From those tables 
we can see that certain tests are virtually unaffected by course work in 
what would seem to be relevant areas. For Instance the Memory for Words 
test (R-212) is not significantly correlated with foreign language courses 
even though foreign language study might reasonably be supposed to afford 




experience and practice in just the sort of memorizing tested by the Memory 
for Words test. In using the Table 8-4 and 8-7 data to draw inferences as 
to which tests may be functioning as aptitude measures we must bear in mind 
that some of the correlations between test score and number of courses might 
in some cases be spurious, being explained by an underlying variable such 
as college plans or socioeconomic index. Also to be taken into consideration 
is the nature of the test Itself. 

Bearing these various considerations in mind, we may tentatively conclude 
that the following nine tests provide a sufficiently stable picture between 
grades 9 and 12 that they may be regarded as constituting aptitude measures: 

R-290 Abstract Reasoning 
R-311 Arithmetic Reasoning 
R-212 Memory for Words 
R-220 Disguised Words 
R-102 Vocabulary I 
R-109 Scientific Attitude 

R-260 Creativity 

R-270 Mechanical Reasoning 

R-281 Visualization in Tsao Dimensions 

The first six of these are probably primarily measures of "general 
verbal ability" or "general mental ability"--in other words of the general 
factor (Factor VERBL) from the Chapter 6 factor analysis. The remaining 

three aptitude tests listed above (R-260, R-270, and R-281) probably should 
be regarded primarily as measures of specialized aptitudes — although at least 
two of these tests (R-260, R-270) also have substantial loadings on the 
general factor (VERBL), as seen in Table 6-10. 

Of perhaps fully as much significance as the finding that it is justifiable 
to regard certain tests as aptitude tests is the finding that certain other 
tests which in the absence of specific evidence to the contrary might rea- 
sonably have been surmised to be aptitude measures at the high school level 
turn out to be substantially correlated with amount of course work in cer- 
tain subjects. The two most noteworthy tests in this category are Reading 
Comprehension (R— 250) and Visualization in Three Dimensions (R— 282). As 
has already been noted, scores on the latter test, unlike Visualization in 
Two Dimensions (R-281) have a significant partial correlation with number of 



math courses. As for the Reading Comprehension test, there seems to be a 
tendency for performance on it to Improve more if one plans to go to college 
and takes college-preparatory courses than if one doesn’t. However the picture 
is not entirely clear-cut. Reading Comprehension may still be relatively 
independent of high school course-work effects. Further data analysis (to 
be undertaken in the future) is needed to sort out the cause-and-eff ect 
relationships . 
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Chapter 9. SUMMARY AND CONCLUSIONS 



The high school students of America encountered Project TALENT for the 
first time in the spring of 1960. Nearly half a million students in grades 
9, 10, 11, and 12 in schools in all parts of the country were tested at 
that time, with a comprehensive two-day battery of paper-and-pencil tests 
and inventories developed specially for the purpose. Three years later 
some of the students who had been in the grade 9 group tested in 1960 were 
retested as grade 12 students. The present report is concerned with the 
results of that retesting, the relationship of the results obtained in 
grade 12 to the corresponding grade 9 results, and the nature and magnitude 
of the changes that occurred in the interim. 

THE RETEST STUDY; GENERAL DESCRIPTION 



Purposes of the Study 

Broadly speaking, the study has as its chief purposes to provide 
information about the students and the schools. The approach used is to 
Investigate relationships of various characteristics of the student in grade 12 
to corresponding characteristics possessed three years earlier in grade 9, 
and to the events of the intervening three years. An attempt is made to 
learn something about the factors that produce the changes occurring during the 
three years and the factors that inhibit them. 

A secondary purpose of the study is to provide information about the 
tests. Findings in this category are of interest in the present study 
primarily because they help us to interpret findings about the students and 
the schools. But they have the additional value of being relevant not 
only in interpreting results obtained in the present study of students and 
schools but also in interpreting other research results based on Project 
TALENT data. 
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Design of the Study 

The general outlines of the study are summarized very briefly below. 

The design itself is described in considerable detail in Chapter 2, and the 
technical problems that the design Involves are discussed at some length 
in Chapter 3. 

Sample . In 1963 the grade 12 students in over 100 public secondary 
schools that had been among the schools included in the original TALENT 
testing in 1960 were given an abridged TALENT battery. Approximately 10,000 
grade 12 students were in the group tested. About three-quarters of them 
turned out to have also been in the original TALENT testing, in 1960, as 
grade 9 students. These 7,500 students were the core of the retest study. 

Content and Organization of the Retest Batteries . The instruments 
used in the 1963 testing were identical with those in the original battery, 
with the exception that the biographical inventory (Student Information 
Blank) was abridged and revised for the retest and three of the original 
instruments (Student Activities Inventory, Memory for Sentences Test, and 
Preferences Test) were omitted entirely. Since only one day of testing time 
was available for the retesting, each student could take only about half of 
the total battery. The tests were therefore reorganized into a set of six 
partially overlapping batteries (Batteries A, B, C, D, E, and F), each 
including about half the tests. Each school retested (except for a few 
vocational high schools in which a seventh battery. Battery V, was used) 
was given one of these six batteries. The overlapping of the batteries was 
so arranged that each pair of tests was taken by at least one-sixth of the 
boys and one-sixth of the girls--so that the correlations between any two 
tests could be based on groups of at least that size. To provide a basis 
for checking on the comparability of the groups taking the various batteries, 
and for adjusting statistically to make them more comparable, one test. 
Abstract Reasoning, was included in every battery. 

Additional details about the design are presented in Chapter 2. 

Technical Problems . The system of overlapping batteries, each taken by 
no more than one-sixth of the retested students, engendered two technical 
problems: (1) how to insure a reasonable degree of comparability among 













the six groups taking the basic retest batteries (Batteries A-F), and (2) how 
to correct for missing data in obtaining correlation matrices. These problems 
are discussed in considerable detail in Chaptet 3, and solutions are presented. 
Also discussed in Chapter 3 are the problems inherent in any attempt to 
measure change. 

Data Analysis Operations 

The data analysis involved use of a multiplicity of statistical techniques » 

including, among others, canonical correlation between grade 9 and grade 12 

scores (presented in Chapter 6), factor analysis (also in Chapter 6), 

univariate analysis of variance among schools (Chapter 7), multivariate 

analysis of variance among schools (Chapter 7), multiple discriminant 

function analysis (Chapter 7), partial and part correlation matrices (Chapter 

8) , partial canonical correlation analysis (Chapter 8) , and stepwise multiple 
correlation (Chapter 8) . 

THE STUDENTS AND THE SCHOOLS ; FINDINGS AND CONCLUSIONS 

Relation between Grade 9 and Grade 12 Scopes 

Amount of Growth . The average amount of growth, as represented by the 
difference between grade 9 score and grade 12 score, tends to be substantial 
not only in terms of raw score but also in relation to variation among raw 
scores. In other words the average gain is not merely statistically signif- 
icant; it is also large enough to be important. 

Tt is encouraging to note that the larger gains generally tend to be 
associated with school-taught subjects — or areas such as vocabulary that if 
not taught directly are at least fields in which most schools would like 
to Increase their students' mastery and promote growth. 

Sex Differences in Score Gain . The two sexes show somewhat different 
patterns of mental growth between grades 9 and 12. On most tests the sex 
showing the larger raw gain Is also the one with the higher initial (i.e., 
grade 9) score. 

Correlation between Grade 9 Scores and Grade 12 Scores on the Same Test . 

For the information scales these correlations, when corrected for attenuation. 



tend to be very high — particularly in areas not part of the regular high 
school curriculum. Except in areas such as mathematics, where formal 
instruction is received in different amounts by different students, the 
amount of information a student has sufficient ability and interest to 
acquire and retain is an excellent indicator of what his status in this 
respect will be three years later. 

Aptitude versus Achievement 

The distinction between "aptitude tests" and "achievement tests" is 
a shadowy one — and probably more often a matter of convention than of function. 
Historically, tests measuring certain kinds of abilities have been called 
"aptitude tests" while tests of other kinds of abilities have been called 
"achievement tests." But no really sharp distinction can be drawn on an 
empirical basis between these two categories of tests. The decision as to 
whether a test functions as one or the other should probably be based 
primarily on how and for what purpose it is being used, and on whatever 
relevant empirical data are available — rather than on its name, which all 
too often is the sole basis used for deciding what a test is measuring. 

Pointing up the lack of conclusive empirical evidence identifying some 
tests as ones on which scores are unaffected by outside influences is the 
seemingly contradictory evidence presented by the Chapter 7 and Chapter 8 
research. In Chapter 7 significant differences were shown to exist among 
schools with respect to score changes for virtually all tests, even after 
taking initial ability into account. In Chapter 8, on the other hand, it 
was shown that scores on certain tests (Arithmetic Reasoning and Memory for 
Words, for instance) are unaffected by amount of course work in various 
subjects (math, science, foreign languages). The best resolution of this 
dilemma (pending further research to clarify the situation) is probably to 
assume tentatively that while amount of formal course work in the areas for 
which these counts were included in the analysis may not be relevant, there 
are probably other aspects of the school that are relevant, and that are 
producing the school effects noted in Chapter 7. 



It remains convenient, however, to retain the terminology "aptitude 
tests" and "achievement tests" to describe certain tests when used for certain 
purposes. The use of this terminology is defensible so long as it is borne 
in mind that a sharp distinction, except perhaps in purpose for which the 
test is used, probably does not really exist. It should also be borne in 
mind that what this discussion really refers to is students and their 
abilities, not tests and their statistical characteristics. When we pro- 
claim the impossibility of distinguishing definitely between aptitude tests 
and achievement tests we are saying in effect that any measurable ability 
within the spectrum the TALENT battery is concerned with is apparently 
modifiable as a result of some sort of external effects, during the high 
school years. 

School Effects 

Some schools are doing a better job of educating their students than 
others. As was implied in the previous section, evidence has been presented 
(in Chapter 7) suggesting that schools are affecting performance in most 
areas tested, and that these effects extend beyond those fully explainable 
in terms of differences among the students in initial ability levels. 

The performance-affecting dimensions along which schools differ are 
very numerous- — almost as numerous, if we are to judge by the evidence 
presented in Chapter 7,' as the aspects of performance measured separately. 

In other words there are almost as many independent and important wavs in 
which school practices or other school characteristics differ as there are 
tests to measure differences in performance. (In the foregoing context 
a difference among schools is considered "important" if it related to a 
difference in student performance.) 

Thus we see that the effects of school differences are both numerous 
and fairly substantial in magnitude, and that the school differences which 
bring these effects about are also numerous — though not entirely identifiable 
at this time. 

Of course even a so-called "substantial" effect on measured ability does 
not necessarily affect a large part of its variance. On some basic abilities, 
such as Abstract Reasoning (R-290) and Reading Comprehension (R-250) , it has 
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been shown (see page 6-30) that as much as 80 percent of the variance is 
apparently invariant during the high school years. This leaves only about 
20 percent for school policies, procedures, and practices (and non-school 
environmental factors) to affect. The absence of solid information as what 
the policies, procedures, and practices are that do affect performance on 
"aptitude tests" leaves us with more questions than answers on this topic — 
and with more hypotheses than firm facts. The sources of the changes in 
ability on these "aptitudes" may be something as vague and tenuous as the 
climate of the school, the ambience it provides. It may be a group of 
exceptionally good teachers; or exceptionally good administration. Then 
again, it may actually have nothing to do with characteristics of the school; 
instead the explanation might be in community characteristics — or even, 
conceivably, in student characteristics. 

Effects of Socioeconomic Status 



Just what are the non-school environmental factors that might be 
expected to affect performance in high school? A partial answer to this 
question is that socioeconomic index is a composite of many of them. What 
role, then, does socioeconomic index play in affecting the 20 percent, more 
or less, of reliable, test score variance that seems to represent the propor- 
tion subject to modification? The answer to this question seems to be that 
by the time high school, has been reached the direct effects, whatever they 
may be, have already had essentially their full effect. Presumably insofar 
as socioeconomic status has any new effects on achievement at the high school 
level they are indirect effects, operating by affecting other factors — for 
instance kind of courses taken — rthat in turn affect achievement more directly. 

Effects of Courses Taken 

The amount of course work taken in various subjects has a direct effect 
on test performance in those areas, in many instances. This is hardly 
surprising. After all, making some changes in students' knowledge and 
abilities, through the medium of courses, is a basic purpose of the school. 
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There seem to be a few areas, however, in which practice does not 
make perfect. It is in these areas that we suspect we are getting closest 
to measuring what might be regarded as basic aptitude. For instance, as 
has already been pointed out, foreign language instruction has no apparent 
effect on ability to memorize foreign vocabulary for short-term recall. 

Of perhaps more interest than such cases, where instruction in what 
seems to be a directly relevant area doesn * t have a direct effect on per- 
formance, are cases where instruction does seem to have an effect in an 
area to which it is only indirectly relevant. There are at least two instances 
of this latter phenomenon, one affecting Word Functions (R-240) and the other 
affecting Reading Comprehension (R-250). Foreign language instruction 
apparently improves performance on the Word Functions test, an indirect 
measure of under stvandlng of the functional relationships with which grammar 
is concerned. Thus foreign language instruction affects mastery of an 
important element of English . Likewise performance on the Reading Compre- 
hension test seems to be affected by course wcrk even though formal instruc- 
tion in reading is not usually a part of the high school curriculum. The 
kinds of course work that do seem related to Improvement of reading compre- 
hension are any sorts of courses in a college-preparatory curriculum (math, 
science, foreign language, etc.). Perhaps this is a result of the fact that 
more demands^ are made upon thi student's reading ability in college- 
preparatory courses than in a vocational program. 

Factor Structure 

Factor analyses were carried out separately for each sex, on 95 variables 
(47 grade 9 test scores, the 47 corresponding grade 12 variables, and socio- 
economic index). The results were as follows: 

General Factor . A nearly general factor which seems to be essentially 
a measure of verbal intelligence was identified. 

Number of Common Factors . Forty common factors were extracted for males 
and 40 for females. 

Important Common Factors . Among the Important common factors extracted, 
in addition to general verbal ability are mathematical ability, spatial, 
English, and technical Information. 
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Comparison of Factors for Boys and Girls , There is almost complete 
overlap between the two sets of factors. Of the 40 factors for each sex, 

35 are approximately the same for the two sexes. 

Comparison of Factorial Complexity of Grade 9 and Grade 12 Test Variables . 
The general factor accounts for a larger proportion of the grade 9 variance 
than of the grade 12 variance. This provides some support for the theory that 
special abilities become differentiated out of the single general mental 
ability factor, as the child grows older. 

Change Factors . Two factors with substantial loadings in certain 
grade 12 variables and zero or near-zero loadings on grade 9 variables showed 
up— one in English and one in information. These are "change factors" 
representing growth or other change in relative status between grades 9 and 
12. These factors are entirely Independent of other factors having loadings 
for grade 9 as well as grade 12, on the same tests. 

"Test-specific" Factors . Twenty-three of the 40 common factors for each 
sex are "test-specific factors," having loadings on only two variables — the 
grade 9 and grade 12 scores for a single test. 

FINDINGS ABOUT THE TALENT BATTERY 



Speededness of the Tests 

Empirical data confirmed that most of the tests were speeded (or unspeeded) 
to just about the degree that was specified in the original test rationale. 

Accuracy of Answer-Sheet Marking 

The accuracy of answer-sheet marking was studied empirically with 
particular reference to the Student Information Blank. Although there is of 
course some clerical inaccuracy in any large-scale answer-sheet-marking enter- 
prise, its frequency of occurrence seems to be fairly low. The heaviest 
occurrence is concentrated among a limited number of items in such a way 
that it is entirely reasonable to suppose that the present study is not 
affected to any Important degree. 



Reliability 



Test Reliability » The tests on the whole have very satisfactory 
reliability coefficients in relation to test length. 

Reliability of Difference Scores . Reliability coefficients for differ- 
ences between correlated scores tend to be low. But some of the TALENT 
tests turned out to have surprisingly high reliabilities for the difference 
between grade 9 and grade 12 scores. 

Reliability of Residual Scores . Residual grade 12 scores (after 
elimination of the component predictable from the corresponding grade 9 
scores) have satisfactory reliability. They are generally more reliable 
than difference scores. 



MISCELLANEOUS METHODOLOGICAL FINDINGS AND CONCLUS ION S 



Determination of Reliability Estimates 

1. Empirical comparisons confirm that KR-21 reliability estimates are 
systematically lower and far less accurate than split-half reliability 
coefficients (corrected by Angoff formula 16). 

2. KR-20 estimates also tend to be at least slightly lower (and less 
accurate) than split-half estimates. 

3. An empirical check shows that the correction-f or-range procedure 
for estimating the reliability of a group from that for a different 
group provides highly accurate estimates. 



Obtaining Consistent Correlation Matrices 

The need for correlation matrices based on students in all six of the 
basic retest-battery groups presented numerous technicr.l difficulties. The 
matrices, needed for use in multivariate analyses, necessarily involved large 
amounts of missing data and possible inconsistencies resulting from the fact 
that the six retest-battery groups were almost certainly not entirely 
equivalent. The problems were solved by means of a trio of methodological 
innovations: 
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1. Weighting the cases to make the six retest-battery groups equivalent 
(within sex) on the one test all batteries shared, Abstract Reasoning. 

2. Using a new method, specially developed for the purpose, to correct 
for missing data. 

3. Following this by another new, specially developed technique to 
insure that the final matrix would be internally consistent. 

Careful study of the characteristics of the resultant matrices and the 
intermediate data Involved in their computation suggests that the trio of 
new techniques listed above works well. 



Interpretation of Canonical Correlations 

1. The concept of "canonical factors" is introduced (in Chapter 6), as 
an aid in interpreting canonical correlations. A "canonical factor" 
is defined as the hypothetical factor assumed to underlie two 
corresponding canonical variates and to account for the canonical 
correlation between them. Using this definition and a minimal 
number of supplementary assumptions, the canonical correlation 
coefficient (not its square) is shown to represent the proportion 

of the canonical variate’s variance explained by the canonical 

^ 1 
factor. 

2. A formula that makes clear the analogy between the proportion of 
total reliable within-battery variance accounted for by the first 
k canonical factors and a zero-order correlation co<.fficient 

corrected for iittenuation is derived.^ 



Factor Analysis Methodology 

Several methodological innovations, and some other techniques that 
though not necessarily brand-new are relatively uncommon, were used in the 
factor analyses presented in Chapter 6. The reasons for using these relatively 
novel techniques are presented in that chapter. They seem to have worked well. 
Among these techniques are: 



1 



The algebraic derivation is presented in Appendix H- 
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1. Use of the multiple correlation coefficients (not their squares) 
as the coiranunality estimates inserted in the diagonal of the 
correlation matrix. 

2. Inspection of the distribution of correlation residuals rather than 
use of some arbitrary cut-off on eigenvalues, as the basis for 
deciding how many principal factors to retain. (This procedure 
resulted in retention of considerably more factors than cutting 
off at an arbitrary eigenvalue would have.) 

3. Subjectively determined rotations of factors, where analytic 
procedures (quartlmax, varlmax) did not give satisfactory results. 

4. Arbitrary extraction of "test-specific” doublet factors having 
loadings on only two variables, the grade 9 and grade 12 scores 
for a single test. 



Factor Analysis of Retest Data 



Use of retest data (l.e., two administrations of a battery, with a 
substantial time Interval between testings) provides insights that would be 
unavailable in the usual factor analysis, based on a single administration 
of the battery. More specifically these are some of the useful properties 
of a factor analysis of retest data: 

1. It permits the extraction of test-specific common factors. 

2. It reveals "change factors" that otherwise would not appear as 
separate factors — or if they did would almost certainly be mis- 
interpreted. 

3. It prevents misinterpretation and misunderstanding of some other 
common factors as well. 



Of course retesting is not always feasible or desirable from an 
administrative viewpoint, but when retest data are available, much informa 
tion can be gained by including both sets in a factor analysis. 



IMPLICATIONS FOR EDUCATION 



The outcomes of the research described in this report have implications 
for many aspects of education. A few of these implications are presented 
below. 
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The Disadvantaged Child . The handicap that disadvantaged youngsters are 
under appears to have taken root firmly by the time high school is reached. 
This finding that whatever direct effect socioeconomic factors have on 
abilities of the types measured by the TALENT battery occurs before grade 9 
supports the idea that special efforts to help the disadvantaged child over- 
come the handicaps imposed by a deprived background should concentrate on 
younger age levels — as Project Headstart is doing, for instance. The very 
effective program developed by Carl Bereiter and Siegfried Engelmann at the 
University of Illinois* Institute for Research on Exceptional Children is 
another example — and a daringly novel one — of this approach. The implication 
of the present research findings is that postponement of remedial efforts 
until high school would sharply curtail the success of such efforts. 

General Education versus Vocational Education . The preliminary finding 
that reading comprehension Improves in high school somewhat more for students 
taking a lot of academic courses than for students taking less of this kind 
of classwork suggests that it would be worthwhile to focus attention on 
research concerning the academlc-versus-vocatlonal-educatlon issue. Reading 
is undeniably an Important skill. A deficiency in it Imposes a great 
handicap on adults. Therefore it would be well to find out, through research 
designed especially for the purpose, whether the boy or girl taking a 
vocational program in high school will as an indirect and unsought consequence 
have less reading competence in adult life than he otherwise would. If it 
is found out that this is Indeed the case, redesigning vocational courses in 
such a way as to provide more practice in reading and mere motivation to 
read, thus bolstering the student's competence in this area, would be well 
worth while. Steps in this direction have already been taken in some 
vocational high schools. A strong research finding supporting such steps 
might result in other schools following suit . 

Effective and Ineffective High Schools . Evidence has been uncovered 
that some schools are doing a better job of educating their students than 
other schools are. It isn't just a matter of some schools having more able 
students than others (although this is a factor that explains part of the 
difference, of course). Furthermore schools differ in regard to the subject- 
matter areas in which they are especially successful. These are encouraging 
findings. If it had developed that schools don't differ in regard to the 
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characteristics of the graduates they turn out, it would be very difficult 
Indeed to find evidence in support of the notion that any schools do anything 
that is especially effective— which would be a most discouraging conclusion 

for those who have any stake in the effectiveness of American schools. And 
that includes just about everybody. 

Although the conclusion that schools do differ in effectiveness bodes 
well for the prospects of future improvements in education, to put the 
potential improvements into effect we have to know what they are. Further 
research is the key to that. The finding that schools differ in effective- 
ness provides a very important guideline for future research, focusing on 
the problem of identifying the. crucial ways in which the more effective 
schools differ from the less effective ones. Such research is necessarily 
complex and difficult, but if it could throw light on what schools can do 
to improve their effectiveness it would be well worth the effort. 
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SYSTEM OF TALENT VARIABLE NUMBER DESIGNATIONS 




Appendix A. System of TALENT Variable Number Designations 



I. General format 

The code for a variable consists of the three-digit variable number 
prefixed by a capital letter representing the kind of score. 

II. Letter code for kind of score 

The capital letters used as standard prefixes for Individual score 
variables have the following meanings: 

R - Number of Right responses 

W = Number of Wrong responses 

A s Number of Items Attempted 

This means the number of Items to which some response 
Is marked. Items that are deliberately omitted and Items 
that are not reached are not Included In this count. 

0 - Number of Fitted Items 

K = Correctlon-for-chance score (Estimated number ^own)^ 

P = Per Item scored 

2 

P* = Standardized Per-ltem score 
F = Other Formula score 

This score Is usually a function of the R and A scores, 
or of R and W, or of variable weights for Item responses. 
The F scores may represent either empirical or a priori 
scoring formulas.^ 

L - Item number of Ijast Item marked 

X - Scores not obtainable from responses to the regular TALENT 
battery (e.g., scores Involving responses to Items In the 
1963 SIB (Form B) , but not In the regular SIB administered 
In 1960) . 3 



See Appendix D-1 for details concerning specific scoring formulas used. 

2 

For Instance, P^^'SOl, Socioeconomic Index. (See Appendix E for details.) 

3 

See Appendix D-2 for details concerning scores In this category. 
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Appendix A (continued) 



Basic formulas involving the above kinds of scores are: 



R + W = A 
A + 0 = N 



K = R - 



W 

n-1 



I 

nR - A 
n-1 



where 




Number of items in test 

Number of options per 
item 



III. Three-digit variable-number code (test number code) 

The following is the system used for the first digit of the three- 
digit numbers that follow the "kind-of-score" letter and represent 
individual variables:^ 

1. Information test scores 

2-4. Other aptitude and achievement tests 

2. Verbal, spatial, mechanical, etc* 

3. Mathematics 

4. Speed and accuracy 

(Perceptual, clerical, and computational) 

5. Special 

6. Student Activities Inventory (SAI) 

7. Interest Inventory 

8. Student Information Blank (SIB) 

9. Other 



For specific three-digit codes for Individual variables, see second column 
of Appendix B. 
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COMPOSITION OF THE PROJECT TALENT BATTERY (1960) 



Content 



Aptitude and Achievement Tests 



Miscellaneous 



Inventories 



B-2 

B-5 

B-5 
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Appendix B. Composition of the Projert TALENT Batterv (I960) 



Variable // Code^ 

Kind Test Code 
of # 

score^ (3 digits) 



Options 

per No. of 

Item Items 



APTITUDE AND ACHIEVEMENT TESTS 







Information Test: 


(395) 






Part I 


5 ( 252 ) 






Subscales 




R 


101 


1. Screening 


12 


R 


102 


2. Vocabulary 


21 


R 


103 


3. Literature 


24 


R 


104 


4. Music 


13 


R 


105 


5. Social* Studies 


24 


R 


106 


6. Mathematics 


23 


R 


107 


7. Physical Science 


18 


R 


108 


8. Biological Science 


11 


R 


109 


9. Scientific Attitude 


10 


R 


110 


10. Aeronautics and Space 


10 


R 


111 


11. Electricity and Electronics 


20 


R 


112 


12. Mechanics 


19 






a. Tools and construction 


(10) 






b. Motors and mechanisms 


( 9) 


R 


U3 


13. Farming 


12 


R 


114 


14. Home economics 


21 






a. Cooking 


(11) 






b. Other 


(10) 


R 


115 


15. Sports 


14 


R 


190 


Part I Total 


(252) 
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No . of 
minutes 
working 

timec 



(125) 
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Appendix B (continued) 



Variable // Code^ 

— No. of 



Kind 


Test Code 




Options 




minutes 


of 


// 




per 


No. of 


working 


score® 


(3 dieits) 




item 


items 


time^ 






Information Test (continued) 












Part II 


5 


(143) 


35 






Subscales 








R,K 


131 


1. Art 




12 




R,K 


132 


2. Law 




9 




R,K 


133 


3. Health 




9 




R,K 


134 


4. Engineering 




6 




R,K 


135 


5. Architecture 




6 




K 


136 


6. Journalism 




3 




K,K 


137 


7. Foreign Travel 




5 




R,K 


138 


8. Military 




7 




R,K 


139 


9. Accounting, Business, Sales 




10 




R,K 


140 


10. Practical Knowledge 




4 




%K 


141 


11. Clerical 




3 




r;k 


142 


12. Bible 




15 




R,K 


143 


13. Colors 




3 




R,K 


144 


14. Etiquette 




2 




R,K 


145 


15. Hunting 




5 




R;K 


146 


16. Fishing 




5 




r;k 


147 


17. Outdoor Activities (other) 




9 




R»K 


148 


18. Photography 




3 




R,K 


149 


19. Games (sedentary) 




5 




R,K 


150 


20. Theater and ballet 




8 








a. Theater 




(6) 








b. Ballet 




(2) 




R,K 


151 


21. Foods 




4 




R,K 


152 


22. Miscellaneous 




10 




R,K,L 


192 


Part II Total (including 10 misc. items) 




(143) 




R,K 


162 


Vocabulary (overlapping other scales) 




(9) 








Parts I and II combined 




(395) 


(125) 


R 


172 


Vocabulary scale (Variables 102 and 162) 




(30) 




R 


100 


Grand Total (Variables 190 and 192) 




(395) 
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Appendix B (continued) 



Variable // Code^ 








No. of 


Kind 


Test Code 




Options 




minutes 


of 


// 




per 


No. of 


working 


h 

score” 


(3 dimts) 




Item 


Items 


tlme*^ 


R 


211 


Memory for sentences 












Study 


- 


(40 senten- 


6 










ces) 


• ' 






Test 


5 


16 


10 


R 


212 . 


Memory for Words 












Study 


- 


(24 words) 


2 






Practice 


- 


(24) 


2 






Test 


5 


24 


4 


R 


220 


Disguised words 

t ' 


5 


30 


3 






English 




(113) 


52 


R 


231 


1. Spelling 


5 


16 




R 


232 


2. Capitalization 


2 


33 


4 ^ ** 


R 


233 


3. Punctuation 


3-5 


'1 








a. Punctuation marks 


3-5 


(16) 


* 






b. Sentence structure , 


3 


(11) 




R 


234 


4. English usage 


3-5 


25 




R 


235 


5. Effective expression 


3-5 


12 




R 


230 


Total 




(113) , 




R 


240 


Word Functions 












Directions 


- 


- . 


25 






Test 


5 


24 . 


15 


R 


250 


Reading comprehension 


5 


48 


30 


R 


260 


Creativity 


5 


20 


20 


R 


270 


Mechanical reasoning 


3 *5 


20 


11 


R 


281 


Visualization In 2 dimensions 


5 


24 


4 


R 


282 


Visualization In 3 dimensions 


5 


16 


9 


R 


290 


Abstract reasoning 


: 5 


15 


11 

-1 






Mathematics 




(54) 


50 


R 


311 


Part I. Arithmetic reasoning 


4-5 


16 




R 


312 


Part II. Introductory high school math. 


5 


24 




R 


320 


Math I and II 




(40) 




R 


333 


Part III. Advanced high school math. 


5 


14 




R 


334 


High school Math (Parts II and III) 




(38) 




R 


340 


Total (Parts I, II, and III) 




(54) 




F,R,A 


410 


Arithmetic computation 


5 


72 


9 


F,R,A 


420 


Table reading 


5 


72 


3 


F,R,A 


430 


Clerical checking 


2 


74 


3 


F,R,A 


440 


Object Inspection 


5 


40 


3 
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Appendix B (continued) 



Variable // Code^ 


■ 




No. of 


Kind Test Code 


Options 




minutes 


of // 


per 


No. of 


working 


scored (3 digits) 


item 


items 


time*^ 



MISCELLANEOUS 

A 300 Preferences test 2 166 3 

Themes “ 2 10+ 

"My Views about an Ideal Occupation" 

"What High School Means to Me" 



INVENTORIES 





600 


Student Activities Inventory 


5 (150) 






Regular scales 


(108) 


R 


601 


Sociability 


12 


R 


602 


Social sensitivity 


9 


R 


603 


Impulsiveness 


9 


R 


604 


Vigor 


7 


R 


605 


Calmness 


9 


E 


606 


Tidiness 


11 


R 


607 


Culture 


10 


R 


608 


Leadership 


5 


R 


609 


Self-confidence 


12 


R 


610 


Mature personality 


24 






Experimental scales 


(18) 




611 


Conventionality 


4 




612 


Theo ret leal ity 


8 




613 


Group centeredness 


6 



Miscellaneous 24 
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Appendix B (continued) 



Variable // Code^ 

Kind Test Code 
of // 

score” (3 digits) 



L 



700 Interest Inventory 

Part I. Occupations 
Part II. Activities 



No. of f 
minutes | 
No. of working | 
items time*'- 



5 205 

( 122 ) 

(83) 




Options 

per 

item 



Scales: 



(173) 



P,F* 


701 


Physical Science (Engineering (Mathematics 


P,F* 


702 


Biological Science, and Medicine 


P,F* 


703 


Public service 


P.F’^ 


704 


Literary-linguistic 


P,F* 


705 


Social service 


P,F* 


706 


Artistic 


P,F* 


707 


Musical 


P,F* 


708 


Sports 


P,F* 


709 


Hunting and fishing 


P,F* 


710 


Business management 


P,F* 


711 


Sales 


P,F* 


712 


Computation 


P,F* 


713 


Office work 


P,F* 


714 


Mechanical-technical 


P,F* 


715 


Skilled trades 


P,F* 


716 


Farming 


P,F* 


717 


Labor 



16 

8 

11 

16 

12 

7 

5 

8 
3 

14 

6 

10 

7 

15 
18 

7 

10 



Other items 



(32) 






L 



800 Student Information Blank 



2-36 (394) 80 



P* 801 



Socioeconomic index 



9 



®The system of variable-number codes is explained in Appendix A. 



^This column shows the kind(s) of score available or obtainable. When more than one letter appears, 
the first one represents the kind of scores most frequently used in this report for the particular 
test. The letter is thus the most common prefix for the three-digit number in the complete 
variable-number code. 

^Does not include the time used for giving directions except where otherwise indicated. (The 
exceptions occur where comprehension of directions is considered an integral part of the testing 
time allowance.) 
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Append ix 



C-1 



C-2 



C-3 



C-4 



C-5 



ORGANIZATION OF RETEST STUDY 



Title 



Revision of 1960 Instruments for Use in Retest 



Composition of the Seven Retest Batteries 
(Spring 1963) 



Test Administration Categories 



TABLE C3-1. Retest Battery Combination 

Corresponding to Administration 
Categories 



TABLE C3-2. Administration Category of Each Test 



Battery 0\^erlap 



Retest Case Classification Code 



Page 



C-2 



C-3 



C-4 



C-4 

C-5 



C-6 



C-7 



1 



Appendix C-l. Revision of 1960 Instruments for Use in Retest 



Variable // Code 



Kind 

of 

score 


Test Code 
// 

(3 digits) 


Options 

per 

item 


No. of 
items 


No. of 
minutes 
working 
time 




800* 


Revised Student Info. Blank 










(Form B) 2-36 


158 


50 






No. of courses taken 






X 


891* 


No. of math courses taken 


( 7) 




X 


892* 


No. of phys. sci. courses 










taken 


( 2) 




X 


893* 


No. of science courses 










taken 


( 5) 




X 


894* 


No. of foreign language 










courses taken 


( 6) 








"Goof scores"^ 






X 


801* 


Goof-1 


(10) 




X 


802* 


Goof-2 


(19) 




X 


803* 


Goof —3 


(29) 




X 


804* 


Goof-4 


(40) 


■ 


X 


805* 


Goof-5 


(52) 




X 


806* 


Goof-6 V 


(42) 




X 


807* 


Goof-7 


(33) 




X 


808* 


Goof-8 


(23) 




X 


809* 


Goof-9 


(12) 





Themes 

"My Views about an Ideal 

Occupation" 5 

Theme on help received from 

testing and counseling 15 



Note: Except for the SIB and the themes, as indicated above, all of the tests 

and inventories used in the 1963 retesting were identical with the ones 
used in 1960 in the original testing. 

See Appendix D-2 for details about these four variables. 

^"Goof-scores" are special scores intended to provide some indication of the 
validity of the SIB responses in general. The procedure for obtaining these 
scores is described in Appendix D-2. The scores are further discussed, and 
results obtained from analyzing them are presented, in Appendix F. 



% 
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Appendix C-2, Composition of the Seven Retest Batteries (Spring 1963) 
Test 

Code // Test Battery 



190 


Information I 


A B 


C 








V 


192 


Information 11 


A 




D 


E 






211 


Memory for Sentences* 














212 


Memory for Words 


B 




D 




F 




220 


Disguised Words 




C 




E 


F 




230 


English 


B 




D 




F 


V 


240 


Word Functions in Sentences 




C 




E F 




250 


Reading Comprehension 




C 




E 


F 


V 


260 


Creativity 




C 




E 


F 


V 


270 


Mechanical Reasoning 




C 




E 


F 


V 


281 


Visualization in Two Dimensions 




C 




E 


F 




282 


Visualization in Three Dimensions 




C 




E 


F 


V 


290 


Abstract Reasoning 


A B 


C 


D 


E 


F 


V 


311 


Math 1. Arithmetic Reasoning 


B 




D 




F 


V 


312 


Math 11. Introductory H.S. Math 


B 




D 




F 




333 


Math 111. Advanced H.S. Math 


B 




D 




F 




410 


Arithmetic Computation 


B 




D 




F 


V 


420 


Table Reading 


t 


C 




E 


F 




430 


Clerical Checking 




C 




E 


F 


V 


440 


Object Inspection 




C 




E 


F 


V 


500 


Preferences* 














600 


Student Activities Inventory* 














700 


Interest Inventory 


A 




D 


E 






800’ 


Revised Student Information Blank 


A 




D 


E 







Themes 

"My Views about an Ideal Occupation" A D E 

Theme on help received from testing 

and counseling A D E 



Not included in any retest battery. 
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Appendix C-3. Test Administration Categories 



TABLE C3-1. Retest battery combinations corresponding 
to administration categories 



Administration 

Category 

0 

1 

2 

3a 

3b 

4a 

4b 

5 



Retest 

Battery 

Combination^ 



A-F, V 
A-C, V 

A, D, E 

B, D, F, V 

B, D, F 

C. E. F. V 
C, E, F 



Any test included in all of the retest batteries 
Included in the combination and in no other retest 
battery is in the corresponding administration 
category. 
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TABLE C3-2. Administration category of each test 



Test 

Code 

// 


Tests 


Administration 

Category® 


101-115,190 


Info. 1 scales and total 


1 


131-152,162,192 


Info* 11 scales and total 


2 


172,100 


Info. 1+11 scales and total 


5 


211 


Memory for Sentences 


- 


212 


Memory for Words 


3b 


220 


Oisguised Words 


4b 


231-235,230 


English subscores and total 


3a 


240 


Word Functions in Sentences 


4b 


250 


Reading Comprehension 


4a 


260 


Creativity 


4a 


270 


Mechanical Reasoning 


4a 


281 


Visualization in Two Dimens lens 


4b 


282 


Visualization in Three Dimensions 


4a 


290 


Abstract Reasoning 


0 


311 


Math 1. Arithmetic Reasoning 


3a 


312,333,334 


Hath 11, Math 111, and sum 


3b 


320,340 


Math 1+11, Math total 


3b 


410 


Arithmetic Computation 


3a 


420 


Table Reading 


4b 


430 


Clerical Checking 


4a 


440 


Object Inspection 


4a 


600 


Student Activities Inventory 


- 


700 


Interest Inventory 


2 


800 


Student Information Blank (1960 version) 




800 » 


Student Information Blank (1963, Form B) 


2 



cl 

Tests in the same administration category were included in exactly the same 
combination of retest batteries. 
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Appendix G-4. Battery Overlap 



TABLE C4-1. Retest batteries taicen by the students (represented in 
the previous table) on ¥hom correlations are based 

NOTE: In this table ^ each grade 12 variable is 

represented by the "adniinistration category" 



m 

ve 

CN 

r-| 

I 

W' 

(Ui 

H' 

P! 

t 

Oi 

rH 

0) 






in which it falls. 

a 

Retest battery taken 


Admin. 


Grade 


12 variables - 


1963 






Gr,9 


itegory-^ 0 


1 2 


3a 


3b 


4a 


4b 


5 


i 960 


v!' 
















0 A-F,V 


ABCV ADE 


BDPV 


BDP 


CEPV 


CEP 


A 


A-P,V 


1 


ABCV A 


m 


B 


CV 


C 


A 


ABCV 


2 


ADE 


D 


D 


E 


E 


A 


ADE 


3a 




BDPV 


BDP 


FV 


P 


- 


BDPV 


3b 






BDP • 


P 


P 


Ml 


BDP 


4a 








CEPV 


CEP 


•M 


CEPV 


4b 










CEP 


- 


CEP 


5 












A 


A 



Grade 9-lS^O 



A-P,V 



^Battery V cases are automatically eliminated when Retest Weight Z is applied, 
since the weight is 0 for all Battery V cases. 
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Retest Case Classification Code 



Appendix C-5. 

A ’’retest case classification code” indicating whether the student has com- 
plete test data, both in 1960 and 1963, for the tests he was supposed to 
take in 1963^ has been added to the retest tape. The following code has been 
used: 

0. Complete on 1963 data (for the retest battery taken), and 
corresponding 1960 data. 

1. Complete on 1963 data (for the retest battery taken); and a 
matching 1960 record has been located, but some or all of the 
1960 variables corresponding to those in the 1963 retest battery 
taken are missing. 

2. Complete on 1963 data (for the retest battery taken), but there 
is no record that the student was tested in 1960. 

3. Incomplete on 1963 data, but a matching 1960 record (not nec- 
essarily complete) has been located. 

4. Incomplete on 1963 data and no corresponding 1960 master file 
record has been located. 

In determining what the relevant variables were for students taking retest 
batteries A, B, C, D, E, F, and V respectively. Appendix C-2 was used but 
the ’’Themes” (which were part of retest batteries A, D, and E) were excluded 

t 

from consideration. 



SCORING FORMULAS 



Appendix Title page 

D-1 Scores Derivable from Regular TALENT Battery D-2 

D-2 Scores Derivable from Revised SIB (Form B, 1963) 

Only 



1* Number of courses taken 
2. Goof Scores 



D-4 

D-4 

D-6 



D-2 



Appendix D-1. Scores Derivable from Regular TALENT Battery 

F-scores 

F_410 = R - 3W = 4R - 3A 
F-420 =R-W =2R-A 
F_430 = R - 3W = 4R - 3A 
F-440 =R-W =2R-A 

K-scores 

Information Test scores 




English Test scores 



K-232 = R - W = 


2R - A 


K-233a = R - ~ = 


4R - A 


3 


K-233b = R - 1 - 


3R - A 


2 


K-233 - (K-233a) 


+ (K-233b) 


K-234 = R - ~ - 


5R - A 


4 


W 

K-235 * R - ^ = 


3R - A 


2 


K-230 = (K-231) 


+ (K-232) + 



Mechanical Reasoning scores 



K-270 = R - f = 



All other aptitude and achievement tests 





Appendix D-1 (continued) 



P-scores and F*scores for Interest Inventory 

There are two different sets of Interest Inventory scores that have been used 
extensively. They are designated respectively F*701 through F*717 and P-701 
th rough P-7 17. The latter is the one recommended for most purposes. In these 
two Interest Inventory scoring systems, each item is scored as follows: 



In the above scoring procedures, response weights* have the following interpre- 
tation: 

w = Item score 

w* = Weight for answering item 

If Zw* — 0, scores on P-701 through P—717 are indeterminate, and are therefore 
represented on the tape by -0. 

P* scores 

For details concerning P*801 (Socioeconomic index), see Appendix E. 



Item Score (w) Weight 



F*701 P-701 for Answer 



Response 



Option 



Through Through ing Item 
F*717 P-717 (w*) 



A Like very much 

B Like fairly well 

C Indifferent or don’t know 



D Dislike a little 

E Dislike very much 



4 

3 

2 

1 

0 



4 

3 

2 

1 

0 



1 

1 

1 

1 

1 



Omit 



2 



0 



0 



Scoring formula 
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Appendix D-2. Scores derivable from revised SIB (Form B, 1963) only 



1. Number of courses taken 



The following four variables representing approximate number of semesters 
of high school course work in specified areas were defined: 



Variable X-891*. 
Variable X-892*. 
Variable X-893*. 
Variable X-894*. 



Number of courses 
Number of courses 
Number of courses 
Number of courses 



in mathematics 
in physical science 
in science 
in foreign language 



Scores on these four "number of courses" variables are obtained from the 
responses to items 91-108, which are as follows: 



Starting with the ninth grade, how many years of each 
of the following kinds of courses have you taken? Include 
courses which you are taking now. Mark your answers 
as follows: 

A. None 

B. Vi orT year 

C. Wi or 2 years 

D. IVi years 

E. 3 years 

F. 3V2 years or more 

91. First year algebra 

92. Second year algebra 

93. Plane geometry 

94. Solid geometry 

95. Trigonometiy 

96. Analytic geometry and/or calculus 

97. Other math courses, covering some or all of the above topics 

98. Bioiogy 

99. Chemistry 

100. Physics 

101. General science 

102. Other science courses 

103. Latin 

104. French 

105. Spanish 

106. German 

107. Russian 

108. Other foreign language courses 

The procedure used for determining an individual's score on these 
variables was to assign a score to each item response (on the basis indicated 
in Table D2-1, and then to add the item scores. In this table a dash (-) 
appearing in the place of an item response score represents an invalid 
response. If any of an individual's responses to items entering into the 
Variable X-891', X-892 ', X-893 ' , or X-894' score are invalid, his score on 
that entire variable is regarded as invalid — in other words as missing data. 



TABLE D2-1 . Obtaining "number-of-courses” scores on variables 
X-891', X-892'. X-893', and X-894' 



Number of 
Variable courses in; 



SIB items on 

which based Response 



Item Score^ 

SIB SIB SIB SIB SIB SIB 

91 92 93 94 95 96 



SIB 

97 



X-891’ Math 



91-97 



A 

B 

C 

D 

E 

F 



0 

2 

2 



0 

2 

2 



0 

? 

2 



0 

1 

1 



0 

1 

1 



0 0 

2 2 

2 4 

5 

6 
8 



Omit 



SIB SIB 
99 100 

X-892* Physical Sciences 99-100 A 00 

B 2 2 

C 2 2 

D - - 

E - - 

F - - 

Omit 



X-893' 



Science 



b 



98-102 



SIB SIB SIB SIB SIB 
98 , 99 100 101 102 

A 0 C 0 0 0 

B 2 2 2 2 2 

C 4 2 2 4 4 

D - - - 5 5 

E - - - 6 6 

F - - - 8 8 



Omit 



X-894’ Foreign Languages 103-108 



SIB SIB SIB SIB SIB SIB 

103 104 105 106 107 108 

A 0 0 0 0 0 0 

B 2 2 2 2 2 2 

C 4 4 4 4 4 4 

D 5 5 5 5 5 5 

E 6 6 6 6 6 6 

F 8 8 8 8 8 8 



Omit 

0 

A dash (-) represents an item response which is assvimed to be invalid. 

^X-893’ includes both of the SIB items that go into X-892’, and three others as well. 
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2. Goof scores 

A student's SIB "goof scores" are measures of the extent to which he 
marked answer spaces corresponding to nonexistent options. (These 
variables are discussed in Appendix F.) The scores were obtained in the 
following manner. 

1) The 52 items for which there were more answer spaces than options 
were divided into five sets, as follows: 

Lowest and 
highest 
item nos. 



in set 



Set 


1 


First 


: 10' items 


57-161 


Set 




Next 


9 items 


177-211 


Set 


3 


Next 


10 itema 


213-222 


Set 


4 


Next 


11 items 


225-240 


Set 


5 


Last 


12 items 


337-356 



2) Counts were obtained of the number of items to which the student 
gave a nonexistent response. These counts were then combined 
to get the following nine "goof scores." 

Variable Name of Item sets No. of 
// score included items 

' ■ ; included 



X-801* 


Goof-1 


1 


10 


X-802* 


Goof-2 


1-2 


19 


X-803* 


Goof-3 


1-3 


29 


X-804 * 


Goof-4 


1-4 


40 


X-805 * 


Goof-5 


1-5 


52 


X-806* 


Goof-6 


2-5 


42 


X-807* 


Goof-7 


3-5 


33 


X-808* 


Goof-8 


4-5 


23 


X-809* 


Goof -9 


5 


12 



APPENDIX E 



DESCRIPTION OF THE SOCIOECONOMIC INDEX (P*801) 
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Appendix E. Pescription of the socioeconomic index (P*801)* 



Variable P*801 is a socioeconomic index computed for each student on the 
basis of nine 1960 Student Information Blank questions. The items are listed 
below; the weight assigned to each response appears to its left in parentheses. 
A dash (-) appears before options that were not applicable. Items to which 
a student gave these responses were not included in the computation of his 
P*801 socioeconomic index. 

Item 172 . If your family has bought (or is buying) your home what is 
its present value? 

(1) Under $6,000 

(2) $6,000 to $10,000 

(3) $10,000 to $15,000 

(4) $15,000 to $22,000 

(5) More than $22,000 

(-) We are renting our home. 

Item 173 . Please make the best estimate you can of your family’s total 
income for last year (1959) . Include money earned by both parents or 
anyone else in the household who worked. 

(1) Less than $3,000 

(2) $3,000 to $5,999 

(3) $6,000 to $8,999 

(4) $9,000 to $11,999 

(5) $12,000 or more 

(-) I can’t estimate this. 



Item 176 . How many books are in your home? 

(1) None, or very few (0-10) 

(2) A few books (11-25) 

(3) One bookcase full (26-100) 

(4) Two bookcases full (101-250) 

(5) Three or four bookcases full (251-500) 

(6) A room full — a library (501 or more) 



This variable was originally developed by William W. Cooley for use in a 
recent report (Flanagan and Cooley, 1966). Appendix E in that report 
documents the data analysis on which the choice of component items was based, 
and summarizes the computational procedure and the characteristics of the 
resulting index. 
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Items 19Q, 191, 195 . How many of the following articles are in your 
home? 

Item 190 . Automatic washer, automatic clothes dryer, electric dishwasher, 
electric or gas refrigerator, vacuum cleaner, home food freezer (separate 
from refrigerator) 

(1) None 

(2) One 

(3) Two 

(4) Three 

(5) Four 

(6) Five or six 

Item 191 * Telephone, television set, radio, phonograph 

(1) None 

(2) One 

(3) Two 

(4) Three 

(5) Four 

Item 195 . A room of my own, my own study desk, a typewriter 

(1) None 

(2) One 

(3) Two 

(4) Three 

Item 206 . Which one of the following comes closest to describing the 
work of your father (or the male head of your household)? 

(1) Farm or ranch worker 
Workman or laborer 
Private household worker 

(2) Service worker 
Semi-skilled worker 

(3) Farm or ranch foreman 
Protective worker 
Skilled worker or foreman 
Clerical worker 

(4) Farm or ranch owner 
Salesman 

Manager 

Proprietor or owner 
Technical 

(5) Official 
Professional 

(-) I don’t know 
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Item 218 . Mark the one answer indicating the highest level of education 
your father reached, 

(1) None, or some grade school 

(2) Completed grade school 

(3) Some high school, but did not graduate 

(4) Graduated from high school 

(5) Vocational or business school after high school 

(6) Some junior or regular college, but did not graduate 

(7) Graduated from a regular 4~year college 

(8) Master's degree 

(9) Some work toward doctorate or professional degree 

(10) Completed doctorate or professional degree 

(-') I don't know 

I Item 219 . Mark the one answer indicating the highest level of education 

i your mother reached. 

I 

I (1) None, or some grade school 

I (2) Completed grade school 

(3) Some high school, but did not graduate 

(4) Graduated from high school 

I (5) Vocational or business school after high school 

1 (6) Some junior or regular college, but did not graduate 

I (7) Graduated from a regular 4-year college 

(8) Master's degree 

(9) Some work toward doctorate or professional degree 

(10) Completed doctorate or professional degree 

(-) I don't know 



Each student's responses to each of these items (excluding those items 
which he omitted or to which he gave a "not applicable" response) were con- 
verted, on the basis of Grade 12 boys in Subsample A-10.0-3* (N = 2946), to 
standard scores (z) with a mean of 0 and a standard deviation of 1. The means 
and standard deviations used in computing these standard scores are shown in 
Table E-1. 

The usual formula for converting the raw score (X) on each item to a 
standard score (z) was used: 




(In this formula the subscript i identifies the item.) 



This subsample is described in an earlier report (Flanagan et al., 1964, 
pages 2-12 and Appendix A, Table A-1) , 








In order to be able to convert the sum of each student's z, values to 

i 

an overall score (P^801) on a standard score scale It was necessary to have 
an approximation of the standard deviation of the sum of n items. This 
approximation, k^, was computed separately for each possible value of n (the 

number of items entering into the sum) from 1 to 9. The formula used was: 



where r was the mean of the 36 intercorrelations among the nine items, for 
grade 12 boys in subsample A-10.0-3, with each of the correlations based on 
only those boys who had applicable responses for both of the items involved 
in it, (This formula gives an exact value of the standard deviation of the 
sum of the standard scores on n items if all the correlations on which r is 
based are exactly equal, and a good approximation otherwise. 

The values of k are shown in Table E-2. 

n 

Each student's values for all n of the items to which he had applicable 
responses were then used to compute his P*80l score, by means of the following 



P*801 is thus an approximation of a standard score with a mean of 100 and a 
standard deviation of 10. The possible range turns out to be from 58 to 135, 



k^ * / n + n(n-l) r 



formula: 




TABLE E-1. Means and standard deviations on items entering into P*801 



Based on Grade 12 boys in Subsample A-10.0~3 (N = 2946*) 



Item 

No. 


X. 




(i) 


1 


i 


172 


3.21 


1.25 


173 


3.04 


1.13 


176 


3.29 


1.16 


190 


4.29 


1.34 


191 


4.57 


.86 


195 


2.82 


1.01 


206 


3.06 


1.26 


218 


5.07 


2.13 


219 


4.97 


1.65 



Somewhat fewer cases than the total number (2946) were used in deter- 
mining the means and standard deviations, since only those cases with 
applicable responses to an item could be Included in the computation 
of the statistics for that item. 



TABLE E-2. Approximate standard deviations of sums of various numbers 
of items selected from the nine on which P*801 is based 



n k 

n 

(No. of (Approx. 

items) S. D.)* 



1 

2 

3 

4 

5 

6 

7 

8 
9 



1.000 

1.609 

2.186 

2.748 

3.305 

3.858 

4.409 

4.958 

5.506 



The procedure used in computing these approximate standard deviations 
is described on page E-5 of this appendix. 
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APPENDIX F. Description and Analysis of SIB "Goof Scores" 



Description of the Nine Special "Goof Scores" (X-801 ' X-809 ’ ) 

SIB Form B (used in 1963) contains 52 items with fewer options than are 
printed in the 1960 answer sheet, which had to be retained in 1963. These 52 
items are the basis of the "goof scores." The method of determining these 
scores is explained in Appendix D— 2, Section 2. They are measures of the 
extent to which a student marked answer spaces corresponding to nonexistent 
options. Nine goof scores (each based on a different combination of SIB 
items) were obtained for each student who took Retest Battery A, D, or E 
(the three batteries that included the SIB). 

Purpose of Goof Scores 

The goof scores are intended to serve as measures of the extent to which 
a student gave unintended answers on the SIB. High goof scores for an individ- 
ual might be regarded as casting doubt on the accuracy of his responses to 
all of the SIB items in the 1963 retest. 

Differential Functions of the Nine Goof-Score Variables 

'■v. 

X-801 * to X-804 * . The first four goof scores (X-801' to X-804'), espe- 
cially the first, involve items towards the beginning, and are intended to help 
identify students who may have been confused when they first encountered items 
which the answer sheet didn't match. 

X-806' to X-809'. The last four goof scores (X-806' to X-809'), especially 
the last, involve items towards the end, and are intended to help identify 
students who became bored and careless after a while. 

X~805 ' . The middle goof score (X-805') is the one based on all 52 of the 
SIB items involved. Relatively high scores on it would probably be characteristic 
of students whose answer-sheet-marking behavior, for one reason or another, is 
characterized by considerable clerical error. 
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Theoretical Statistical Characteristics of Goof Scores 



Goof scores on the most inclusive scale (Goof-5) can range from 0 (best 
possible) to 52 (worst possible). If all items were marked on the answer sheet 
strictly at random, the average Goof-5 score (X-&05*) would be 16.8, with a 
standard deviation^ of approximately 3.4. Nonexistent options would be marked 
for 32.3 percent, or approximately one in three, of the items. Table F-1 
shows similar theoretical data for all nine goof scores and also for the five 
sets of items that make them up. 

Empirical Data on Goof Scores 

Distributions of goof scores based on all students taking the SIB in 
1963 were obtained. These distributions, based on about 4,300 students, 
showed that about 54 percent of them had Goof-5 scores greater than 0, In 
other words, 54 percent of the students marked a nonexistent option for at 
least one of the 52 items. The mean Goof-5 score was 1.18. In other words 
this was the average number of items (out of 52) for which nonexistent options 
were marked. This probably does not represent an abnormally high rate of 
clerical errors, at least not for students who are particularly prone to 
clerical error. However, since it was a large enough error rate to be cause 
for some concern, distributions of the other goof scores (goof scores 1t4, 
and 6-9) and of responses to specific SIB items were examined. It turned out 
that the great preponderance of error occurred in the first 10 of the 52 items 
(in other words, the items constituting the Goof-1 score) — and more specifically, 
in the first four of these items (i.e., items 5 7-60) r— although item 340, 
which was in the last of the five sets, also accounted for considerable error. 

The fact that there were far fewet 0 scores on the first four goof-score 
variables than on the last four, on which almost all of the scores were 0, 
strongly suggests that error-producing boredom and fatigue did not occur 
towards the end of the inventory in any important amount. 



Estimated by the procedure indicated in Table F-1. 
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TABLE F-1. Theoretical characteristics of goof scores, assuming 
random response and binomial distribution 



Variable 


Goof 

score 


Item 

set 

no (s) . 


n 


P 


y 


0 






1 


10 


.323 


3.23 


1.48 






2 


9 


.329 


2.96 


1.41 






3 


10 


.306 


3.06 


1.46 






4 


11 


.336 


3.70 


1.57 






5 


12 


.319 


3.83 


1.62 



X-801' 


Goof-1 


1 


10 


.323 


3.23 


1.48 


X-802' 


Goof-2 


1-2 


19 


.326 


6.19 


2.04 


X-803' 


Goof-3 


1-3 


29 


.319 


9.25 


2.51 


X-8C4' 


Goof-4 


1-4 


40 


.324 


12.96 


2.96 


X-805' 


Goof-5 


1-5 


52 


.323 


16.80 


3.37 


X-806' 


Goof-6 


2-5 


42 


.323 


13.57 


3.03 


X-807' 


Goof-7 


3-5 


33 


.321 


10.59 


2.68 


X-808' 


Goof-8 


4-5 


23 


.327 


7.52 


2.25 


X-809' 


Goof-9 


5 


12 


.319 


3.83 


1.62 



Notation in this table: 

n = number of items 

p = average chance probability of marking an invalid 
option for an item 

q = 1 - p 

y = theoretical mean assuming random responses 

a = theoretical standard deviation (approximate), 
estimated from the following formula: 



a = ✓ n p q 

This is of course the formula for standard devia- 
tion of a binomial distribution. (This assumption 
that the distribution is binomial simplifies things 
enormously; however the distribution actually 
would not be quite binomial, since the probability 
of marking an invalid answer space if answering 
at random is not identical for all 52 items 
involved . ) 



o 

ERIC 












Examination of appropriate joint distributions made it apparent that if 
students with bad responses (nonexistent options marked) on item 57, 58, 59, 
or 60 were eliminated from analyses involving the SIB, this would eliminate 
almost all of the cases with Goof-1 scores greater than 0. 

Table F-2 summarizes the empirical data derived from the analysis of 
goof scores. This table shows that systematic elimination of cases with Goof-1 
scores greater than 0 would reduce the total number of cases by almost 45 
percent (although we can surmise that the percentage of loss in the matched 
cases, which are less likely to involve a high rate of clerical error than the 
unmatched cases, would be considerably lower); but it would have the desirable 
effect of eliminating over 80 percent of the cases with any goof score greater 
than 0, reducing the 54 percent to a mere 10 percent (of the remaining students) 
having any nonexistent option marked, and reducing the mean Goof-5 score (overall 
goof score) from the original 1.18 items to only .27 items out of 52, or about 
half of one percent of the items. This would represent a substantial purifica- 
tion of the SIB data though at some cost in terms of loss of cases. 

Chapter 4 (pp. 4-31 to 4-34) contains a brief discussion of the goof 
scores, with particular emphasis on the implications of the findings. 
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TABLE F-2. Empirical data on goof scores 

Based on grade 12 cases taking revised SIB (unweighted data) 
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APPENDIX G 



MATERIALS RELATED TO SAMPLE OF SCHOOLS 



Appendix 



G-1 



G-2 



Title 



High School Taxonomy Code 



Selection of the Sample of High Schools to be 
Retested, and Assignment of Retest Batteries 



G-2 



G-4 



Appendix G-1. High School Taxonomy Code 



01-64. Public secondary schools 



01 . 

10 . 



Junior high schools 

Vocational senior high schools 

All vocational and trade high schools 



21-64. 



Non-vocational senior high schools ; (General comprehensive, 
academic or college preparatory, university high schools, and 
schools for superior students) 



21-22. Largest cities (1,500,000 or mors) 

21. Low economic level^ 

22. Moderate and high economic level^ 



31-32. Large cities (250,000-1,499,999) 

31. Low economic level^ 

32. Moderate and high economic level^ 



41-44. Northeast; U.S.O.E. Regions 1 and 2 (Me., N.H., Vt., 
Mass., R.I., Conn., N.Y., N.J., Pa., Del., Md. , D.C.) 



41. Urban (5,000-249,999) - low economic level'*’ 

42. Urban (5,000-249,999) - moderate and high economic 



level- 



43. Small town 

44. Rural 



51-54. 



51. 

52. 



Southeast: U.S.O.E. Region 5 (Va., W.Va. , N.C., S.C., 

Ga. , Fla., Ky., Tenn., Ala., Miss., Ark., La.) 

1 



Urban (5,000-249,999) - low economic level 



Urban (5,000-249,999) - moderate and high economic 
level^ 



53. 

54. 



Small town 
Rural 



61-64. 



61. 

62. 



Midwest and West; U.S.O.E. Regions 3, 4, 6, 7, 8, 9 
(All states other than those listed above) 

Urban (5,000-249,999) - low economic level^ 



Urban- (5,000-249,999) - moderate and high economic 
level 



63. 

64. 



Small town 
Rural 



90-99. Non-public secondary schools 

91. Parochial 

92. Private 









5 



Economic level is based on response to Item 87 of the General School Characteristics 
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Questionnaire filled out in 1960 by each participating achool. Item 87 is shown 
on the next page 
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Item 87 of the General School Characteristics Questionnaire is; 



87. The residences in the area served by your school are best described as 
primarily 



( 


) 


1. 


expensive private homes. 


( 


) 


2. 


moderate-priced homes. 


( 


) 


3. 


low-cost homes. 


( 


) 


4. 


high-rental apartments. 


( 


) 


5. 


moderate-rental apartments. 


( 


) 


6. 


low- rental apartments. 


( 


) 


7. 


low- in come areas. 


( 


) 


8. 


about equally apartments and homes. 


( 


) 


9. 


students are resident students — cannot estimate. 



The ’’low economic level" categories (i.e., taxonomy groups 21, 31, 41, 51, 
and 61) mean responses 3, 6, 7. 

The "moderate and high economic level" categories (i.e., taxonomy groups 22, 
32, 42, 52, and 62) mean responses 1, 2, 4, 5, 8, 9. 













Appendix Gr-2. 



Selection of the sample of hi^ schools to he retested, 
and assignment of retest batteries 



H. S. 

Taxonomy 

Group 


No. of high schools in main retest 
(Batteries A - F) 


‘ study 


No. of 

high 

schools 

retested 

with 

Battery V 


Total no, 
of par- 
ticipating 
schools 


Invited 


Participating 
Total ABC 


D 


E 


P 


01 


0* 


0* 














0* 


- 


10 


7 


7 


1 


1 


1 


1 


1 


2 


10 


17 


21 


0^ 


0** 














0*^ 


- 


22 


0^ 


0** 
















- 


31 


2 


1 


1 














1 


32 


5 


4 


1 


1 


1 


1 






0-x-** 


4 


kl 


2 


2 








1 


1 






. 2 


42 


i4 


12 


2 


1 


3 


2 


2 


2 


0*^ 


12 


43 


8 


7 


1 


2 


1 


1 


1 


1 


0'X~X~X' 


7 


44 


8 


7 


2 


1 


1 


1 


1 


1 




7 


51 


5 


4 




1 


1 


1 


1 






4 


52 


10 


7 


2 


1 


2 


1 




1 


O-M* 


7 


53 


8 


6 


1 


1 


1 


1 




2 


0*^ 


6 


5^ 


l6 


13 


2 


2 


3 


2 


1 


3 




13 


6l 


3 


2 






1 






1 


0'5^X"5(' 


2 


62 


18 


13 


3 


2 


3 


1 


1 


3 


0*** 


13 


63 


20 


11 


1 


3 


1 


2 


2 


2 




11 


64 


i8 


12 


1 


3 


1 


2 


3 


2 




12 


91 


0-5^* 


0** 














0** 


- 


92 




0** 














0** 


■ 


Total 


i44 


108 


18 19 20 17 l4 20 


10 


118 



Not applicable; no grade 12 cases 



** 



Wn-public schools and schools in the largest cities (with an exception for Battery V) 
were excluded from the retest study, for administrative reasons. 



-S/-N/ 

AyAA 



Battery V was limited to selected vocational hi^ schools. 
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MISCELLANEOUS DERIVATIONS 



Appendix 



Title 



Determination of Weight 2 Values 
TABLE Hl-1. Values of Retest Weight 2 

A Theorem about Measurement of Change 

Derivation of Formulas for Determining How 
Much of a Battery's Variance is Attributable 
to First k Canonical Factors 
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I APPENDIX H-1. Determination of Weight Z Values 



A. Characteristics of Weight Z 
1. Function of Weight Z 

WTien each case is weighted by its Weight Z value, the resultant 
percentage distributions of Grade 12 Abstract Reasoning raw scores 
(R-290), within sex, should be identical for all six basic retest 
batteries. 



I 

I 

1 

i 

f 

) 

) 

i 



2. Scaling of Weight Z 

The weighted N for each battery-and-sex combination equals the 
corresponding unweighted N. This, in combination with the basic 
characteristic indicated in paragraph 1 above, makes the weighted 
and unweighted frequency distributions identical, within sex, when 
the six basic retest batteries (A-F) are combined. 



B. Notation: 




T 

j 



N. 

1 



N 



no. of cases in battery i with score j 
no. of cases with score j - column j total 



= ^ hi 

i=A 

no, of cases in battery i = row i total 



15 

■isO 



total no. of cases - 



i=A 



N. 
1 



15 



i = 0 J 



F 15 
i-A j=0 




weight to be applied to each of the f . . cases in cell ij 




f 

1 



I 
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I 
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TABLE Hl-1. Values of Retest Weight 
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These weights are based on the distributions of Table 3-1. 
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APPENDIX H-2. A theorem about measurement of change 



In this appendix, the following theorem about the partial residuals 
of gains scores is proved. 



Theorem: 

The partial residuals of gains score if original score 
is among the set partialed out equals the partial residuals of 
final score with the same variables partialed out. 



Notation: 





I, 

i 

I 

I 

I o 

ERIC 



N = number of cases 

X = score of individual i on variable X 

3 



Scales: 

X = raw score scale 

X. = deviation of raw score X. . from mean X. 

13 3 , 



X . 

13 





N 








standard score 




where s . . = sample standard deviation 




•} 



1 
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= standard score scaled in such a way that 



N 



N 



= 0 and Vt =1 

i=l ^ i=l ^ 



= 0 



s 



t. 

J 



N 



s 



t . 
J 



N 



Var iables; 



= initial score 



X, 



X. 



other covariates 



X 



m 



X = final score 
o 



X 



= raw gain = 



Theorem; 



Xj is a linear function of X 

d.l23...m 0.123. ..m 



■ill 






A 



I 



H-7 






Proof : 



N X (m + 2) score matrix T with elements t 



ij 



is as follows: 



i = 1, 

j ~ dy Oy ly 2y«««m 




= Score Matrix T 





f 

1 

) 

I 

t 

i 




Tj and T are column vectors 
d o 



Matrix X is matrix of deviation scores x.. corresponding to matrix T 

^ J 



Partitioning of correlation matrix R: 







d 


0 


covariates 




1 2 3. . .m 


d 




1 


o 

u 






0 




o 

u 


1 


R 

oc 




covariates 


1 

2 

3 

• 

• 

• 

m 




\d 


R 

CO 


R 

cc 















H-8 



; 



f 



er|c 



Vectors of residuals (of t) 



Aj = column vector of N residuals of t^^ unexplained by 



covariates t., t.« ...t, 

il , i2 , im 



= column vector of N residuals of t^^ unexplained by 



covariates t., t.« ...t, 

il , i2 , im 



and 



A^ = column vector of N residuals of t^^ unexplained by 



t . > b.rt •••t. 

il , i2 , im 



t... = 



111 



ij 



N 




X . 
1 



i 






N 

i=l ^ 



Dropping subscript i: 



t. = 
J 



X. 






= X. k. 

j J 



where k. = 






6 /IT 

X. 

J 









H-9 




r s - r 1 s 

CO X cl X, 

r = r = 2 1 

cd cCo-l'i 












■i 



; 






■(’ 



Aj = IT s - T- s 
d I o X lx 

o 






N - T R 

c cc 



c ®x 

V 



- «cl 1 C^d 






(’ 



T s - T R 
ox c cc 
o 



^ R s \ /¥“ -fT,s -TR^R,s \k, 

7 V " V 



= rr - T R ^ R V 

to C CC col 



rx - T R ‘ R Is k, /IT - 
o c cc col x^ d 



( T, - T R ^ R , |s k 
1 c cc cll x^ c 



/T 



( T - T R ^ R I ^o - (t, - T R~^ R ' | ^1 

O C cc CO 1^ 11 C cc cl 



s s 

X X. 

^ o _ ^ 1 

Os Is 

^d ^d 



The vector of residuals A^ = 0 since t^, the criterion variable, 

is itself included in the set of predictor variables c, and since 
therefore the multiple correlation equals 1. 



. * . A , = A 
d o 



s 



X 



s 



X 



s 



^d*12...m ^0*123. ..m 



X 



X 



Thus td.l2 



is a linear function of 

.m 



' 0-12 



.m 



. Since X is a linear function of t. 



^d*123... 



is a linear function of X 

o*123<p . -m 



m 



H-n 



General conclusion: 



In studying change, analysis of variance of final measures will give the 
same results as analysis of variance of net change (final measure minus 
initial measure) as long as the initial measure is among the set of covariates 
in either case. 



Corollary: 



^d.l23...m ^o.l23...m 



Proof : 



t s 
o X 



N 



t .s 
d X 



/IT ' 



From definition 
of t 
scales 



^ . s rr 

t X 

o o 



s / N 
^d 



t is a linear transformation of x 



. Their standard score forms are equal. 



■is = z 

^o.l23...m o.l23...m 



o 
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^o.l 23 ...m ^o.l 23 ...m 



X - X 

0 . 123 . ..m . o 



’0.123. . .m 



t 100 = 0 

0 . 123 . . .m 



X - 00 =0 



'0.123. . .m 



= X 



0 . 123 . . .m 



s. 



’0.123. . .m 



0 . 123 . . .m 



o. 123 . . .m 



s 



0 . 123 . . .m 



'0.123. . .m 



'0.123. . .m 



R 



0.123. . . in 



= 1 - 



0 . 123 . . .m 



R 



0.123. . . in 



= 1 - 



'0.123. . .m 



'0.123. . .m 



o . 123 . .m 



'0.123. . .m 



"0.123. . .m 



X 






0 . 123 . 



. 123 . ..m 



t • in 






^0.123. . .m 



'o . 123 . . .m 



X 



0,123. . .m 
'0.123. . .m 
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s 



X 



s. 



X 



s 



X 



* ^o.l23...m ^0.123...m ®x 



N 



Similarly: 



d.l23. . .m 



* t 



d.l23..,m X 



N 



. . X 



d.l23. . .m 




m * 



N 




t 1 o o S / N 

0.123. ..m X 

o 



= X 



0.123. . .m 



d. 123. . .m 



^d.l23...m ^d.l23...m 



^o.l23...m ^(o-l).123...m 



^0.123. .,.m ^0.123. ..m ~ ^1.123. ..m 



1 OQ + X ~ 0 

0.123. ..m 0.123.. .m 



^0.123. ..m ^ ^0.123. ..m 



= X 



0.123. . . m 



I o 

ERIC 












APPENDIX H-3. 



Derivation of formulas for determining how much of a 
battery’s variance is attributable to first k canonical 
factors 



\ = 


k canonical variate for grade 9 


\ = 


k*" canonical variate for grade 12 
°A = “b * 1 




k*" canonical r 


'aa ■ 


average test reliability for grade 9 


ir SB 

^bb 


average test reliability for grade 12 


m = 

a 


rank of grade 9 matrix 




rank of grade 12 matrix 


n = 

a 


no. of variables in grade 9 matrix 


% * 


no. of variables in grade 12 matrix 


n’ = 


'no. of canonical correlations 


m’ * 


m or m, (whichever is lower) 
a D 



Factor scores: 



■ 


' canonical factor^ underlying canonical variates and 


\ ■ 


' unique factor for Aj^ 




' unique factor for 



See page 6-26 for an explanation of the "canonical factor" concept. 
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me 



Note; 



is a hypothetical construct containing only common variance, 
and therefore only reliable variance. 



0 ^ = 0 ^ = 0 ~ 1 
P T 



^FS “ ’^FT " ^ST " ^ 



Factor loadings; 

is factor loading of on Fj^ 



is factor loading of on Fj^ 



k 

'k 



is factor loading of on 



is factor loading of on 



^A B ^ 

j 


(i ^ J) 


^F F ~ ^ 
i 3 


(i i* j) 


^A F. " ^B.F " ^ 
i 3 1 j 


(i ^ i) 



A, = cx, F, + e, S, 
k k k k k 



\ = Vk + “k\ 



’^A. B. “k^k 
k k 



(At this point, in the interests of simplicity, we shall drop 
the subscript k. ) 



r.- = a 



AF 















H-16 
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Proportion of variance of A attributable to F 



2 2 
= r*„ - a 

AF 



Proportion of variance of B attributable to F 



2 2 
= 'bf = e 



Converting "proportion" of variance to "amount of variance"; 



Variance on A attributable to F 



„ 2^2 2 22 2 

^ A AF A 



Variance on B attributable to F 






. 'V 

Ai + A2 + ... + Aj 



r =0 

(\, (\j 



2 2 
a, +0 ^ + 

i 2 



(i j) 



+ a 



2 2 
“1 + “2 + 



. + a. 



k 



. E 



1=1 



a. 

1 



= Variance on first k canonical variates in Battery A, 
attributable to first k canonical factors 



i=l 






variance on first k canonical variates in Battery B 
attributable to first k canonical factors 



Similarly 
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Defining total-battery variance 

A battery of rank m has m principal components. All variables 
in the battery may be fully defined in terms of these m principal 

components^ each of which is scaled to have a standard deviation 
of 1. 

With this scaling the variance of the sum of m principal 
components is the sum of their variances since they are uncorrelated. 
Therefore the variance of the sum equals m. 



Total battery variance 

Total grade 9 variance = m^ 
Total grade 12 variance = m, 

D 



Defining total reliable variance of a battery 



- reliability coefficient of test x 

* proportion of test x’s variance that is reliable 
proportion of test x’s variance that is unreliable 



X * X .Pr + X I 1-r 
o XX e W XX 

where X = observed score 
o 

X = true score 

00 

X^ = unreliable component 
' °) 




! 










missam 



mm 
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Each of the n tests has its own X error component and they are 

0 

all uncorrelated. Therefore the sum of the variances they account for 
equals the tota] unreliable variance of the battery. 

The unreliable variance of each test is 1 - r 

XX 

Therefore the total unreliable variance of the n-test battery equals 

I) (^-*^xx) = 



n 
1 



XX 



er|c 



Total reliable variance of a battery equals total battery variance 
minus total unreliable variance 



= m 






r - (n - m) 

XX 



Percent of total Battery A variance attributable to first k 
canonical factors: 



% = 



100 Yt a/ 
1=1 ^ 



m 



Corresponding percent for Battery B 



% = 



100 23 3 / 

i=l ^ 


















Solving these simultaneous equations 





( 2 ) 



{ 



Substituting (2) In (1) 




Similarly: 







Solution 

i 

to 

simultaneous 

equations 



o 

ERIC 



J 















J 



H-21 







k 

^ B 

i=l 1 i 



• 1 a.b. 
1=1 1 1 



Percent of total reliable Battery A variance attributable to 
first k canonical factors: 
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Corresponding percent for Battery B: 





Note that in Case I if the battery matrix is of full rank, 
n = m and the expression in parentheses drops out, so that the 
formula becomes 




(5) 



Note also that if n = m = n, = m, the percentages (given by 

a a b D 

formulas 3 and 4) for the two batteries are Identical. 



Formula 5 above bears a close resemblance to the formula for 
correcting a correlation coefficient for attenuation. As a matter 
of fact when n =* 1, formula 5 reduces to the correction— for— 
attenuation formula if the 100 is dropped, thus changing percentage 
of reliable variance to proportion of reliable variance. 
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APPENDIX I 

’’PSEUDO-MATRICES" CORRESPONDING TO CONSISTENT CORRELATION MATRICES 

OF TABLES 6-la AND 6-lb 



(Based on Matched Cases) 

Table 
No. 

I-l. 

1 - 2 . 



Title 

Pseudo-Matrix of Correlations 
Pseudo-Matrix of Correlations 







Page 


Based on 


Malc^s 


1-2 


Based <on 


Females 


I-IO 



EKLC 

hfiiinniiFiiffTiiaaaia 









I 



1-2 



TABI^R X’"lt Pgiudo«iiitrU* of CQrrtlatlong b«itd on 



r* 

1 



li 



VarUbli 

Vo6«b< I 
UictvatMro 
Mualc 
Soc« $cud« 
Mach 

Phy«« Soil 
Bio, Sci« 
$ciant,Aet 
Aaro-Spaca 
Biactronic 
Hachanica 
FaiwinB 
Hcwa Ec, 
Sporta 
A« 

Uw 

Haalth 
Eniin, 
Arch, 
Miliury 
Acct|Buai, 
Prac.Knowl 
BibXa 
HuntinB 
Fiahinn 
Outdoor 
Thaatar 
Vocab, II 
Ham, Worda 
DiaB, Vda. 
SpallinB 
Capital, 
Punct, 

Eng, UaaBa 
Efir, Ekp, 
Word. Funct 
Bdg. Compr 
Craativity 
Hach.Raaa 
Via. 2 Dia 
Via. 3 Dia 
Abat.Raaa 
Arith.Raaa 
Int.HSMath 
Adv.HSMatli 
Arlth.Caap 
Tabu UU 
CUr.Chach 



R-102 63 
R-103 63 
1^<0U 63 
R-105 63 
R<^106 63 
K-107 63 
R**10S 63 
R-*i09 63 
R-UO 63 
R-IU 63 
R-U2 63 
B-U3 63 
R-IU 63 
R«U3 63 
R-131 63 
B-132 63 
R-133 63 
R-136 63 
R*133 63 
R-131 63 
R-139 63 
R-140 63 
R»142 63 
R-145 63 
R-146 63 
R-147 63 
R-ISO 63 
B-162 63 
R-212 63 
R-220 63 
R-231 63 
R-232 63 
R-233 63 
R-234 63 
R-235 63 
R*240 63 
R-250 63 
R-260 63 
R-270 63 
R-2B1 63 
R-262 63 
R-290 63 
R-311 63 
R-312 63 
R-333 63 
r*4i0 61 
P-4a0 63 
f-4SO 63 



nr, 

2 , 

3, 

4, 

5. 

6. 

7, 

6 , 

9, 

10 , 

11 , 

12 , 

13, 

14, 

15, 

16, 

17. 

16 , 

19, 

20 , 

21 , 

22 , 

23, 

24, 

U: 

27, 

.26. 

30. 

rrn 

32. 

33. 

34. 

TT. 

37, 

36, 

39, 

40, 

41, 

42, 

nr, 

44. 

■45. 

Ts: 

47, 

66 . 

r«440 63 Obj.Xnap. 
nt R-102 60 Vocab, I 
54. R-103 60 Litaratura 

52. R-104 60 Muaic 

53. R-105 60 Soc. Stud, 

54. R-106 60 Math 

55. R-107 60 Phya. Sci, 

56. R-lOt 60 Bio. Sci, 

57. R-109 60 Iciant.Att 
56. U-110 60 Aaro-Spaca 

59, R-111 60 llactronic 

60, R-112 60 Hachanica 

61, .R-113 60 Faiaing 

62, R-114 60 Hoaa Be, 

63. R-115 60 Sporta 

64. R-131 60 Art 

65. R-132 60 taw 

66. R-133 60 Haalth 



67. 


R-13, 


60 


2ngin. 


69. 


R-13S 


60 


Arch. 


69. 


R‘'13l 


60 


Military 


70. 


R-139 


60 


Acct.Buai. 


71, 


R-1,0 


60 


Prac.Knowl 


72. 


R-1,2 


60 


Bibla 


73, 


R-1,5 


60 


Hunting 


74. 


R-146 


60 


Fiahing 



I 



R-*162 60 
R-212 60 
R-220 60 
R-231 69 
R-232 60 
R-233 60 
R-234 60 
R-235 60 
R-240 60 
R-250 60 
R-260 60 
R-270 60 
R-281 60 
R-282 60 
R-290 60 
R-311 60 
R-312 60 
R-333 60 
F-410 60 
F-420 60 
F-430 60 
F-440 60 
P*B01 60 



Outdoor 
Tnaatar 
Vocab. II 
Mam, Worda 
DiaB* Wda. 
SpallinB 
Capital. 
Punct. 

Eng, Uaaga 

Eff. Exp. 

Word. Funct 

Rdg. Compr 

Craativity 

Mach.Raaa 

Via. 2 Dili 

Via,* 3 Dim 

Abat.Raaa 

Arith.Raaa 

Int.HSMath 

Adv.HSMath 

Arith.Coup 

Tabla 

Clar.Chack 
Obj.Inap. 
Soc ioacon. 



1 




* 


4 


S 


6 


/ 


d 


9 


1C 


11 


U 




, / ^ 1 




, 7 } n 


, / 1 M 5 


• /522 


,r}4h0 


• 60d6 


.6918 


• 6491 


• 5819 


, 4 f 1 1 


, 1 




H i 


, /4 u 


,6725 


,6936 


• iMU 


.5411 


.6022 


• 5081 


• 3915 


♦ 4U^ 


« f*h 7 ) 


f\ 




, ♦ 2 V 6 




, ^ 1 w 5 




.4030 


.55/1 


• 5047 


• 3875 


i 


, 


, 746 , 


• * ‘1 






,731? 


i(i2U 


.5411 


,6203 


.548/ 


.4514 


.4bV8 


. M4»l 


• 6 7 ' 5 


>5 , 






,7743 


. 5 5 




.5903 


.6118 


• 3910 


. i/6 * 




,6 i \fv 


5 


Ui\t 


, /743 




.4550 


. 54 IH 


.6890 


./315 


• 5040 


• tUU. 


, ( ^ ^ it 


, 1 


. i • f 1 


,f*?U 




,655C 




.4952 


.5588 


• 5501 


• 4891 


.4/i 1 


0^» 


,55U 


• 4» 






• i4ifc 


• A 1^42 




.5053 


.4/04 


.4381 




,64tH 




WJ 




, /9U3 


,6R9( 




.5053 




•6431 


.54*4 


. V) M 




,‘i(* .1 


. M 4 7 




• ( U d 


,/3l5 


.5^03 


• 4 /w4 


• 6431 




• 6236 


. A ' U 




, } / 1 5 


. J.,7 ) 


« 'i 5 1 4 


• 1 9 1 (i 


.5046 


Mit 91 


,4361 


• 5464 


• 6236 




• AH #1 


.4 ? 'U 


,4 127 


• Mu 


,45 


, S/liki 


,42U 


• A/U 


.1539 


• 1932 


• 4019 


.4891 






,435,^ 


. 4 4 4 


.43 U 


,*(|4 7 


,4688 


, A A 4* 


,394? 


• 4424 


.4561 


• 4254 


, 441 / 


.‘^404 


.55b| 


^4 


, U 


,5?56 


.4911 


, ^806 


• 4367 


• 4510 


• 3391 


• 3034 


,3l,M 


.6 i4i* 




• « 2i‘ 4 


•M n 




.5/80 


♦ JA20 


.476? 


.5627 


.4538 


• 3977 


. 136b 




• tit 


• 54 >4 


•uf/\, 


,5lV6 


.5693 


,5248 


• 4960 


.5/26 


.4795 


• 4*19 


, 4 U Jl 0 


.64?! 


• (i,. (i2 


.5053 


,4l |4 


• .1 34 1 


.59/4 
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•3603 


•0521 


#1909 


•sSSo 


tt. B-IM to 


•4071 


•4997 


•4653 


•4962 


.3797 


• 3096 


• 3945 




•4367 


.4179 


• 1295 


•1946 


•6631 


TO. l-13t to 


•4039 


• 5041 


•4312 


• 5030 


• 4341 


• ?739 


• 3255 


•4367 




• 3964 


• 1176 


•2964 


•9060 


71. #.ltO to 


• 3592 


•4647 


•4660 


- .4466 


^ .3293 


• 3299 


• 3803 


.•4179 


• 3964 




.1361 


> #2096 


•6000 


Tt. R-ltl to 


•0917 


• 1146 


• 1402 


• 1422 


• 1614 


•0602 


•0521 


• 1295 


• 11/6 


• 1381 




• 3161 


•2060, 


TS. 1-ltS to 


• 1964 


• 1146 


• 1660 


• 2262 


• 2063 


• 1665 


• 1505 


.1946 


•2064 


• 2086 


• 9161 




.2716 


Tt. 1-lti to 


•4356 


• 5020 


•4477 


• 5099 


• 4481 


• 3165 


• 3600 


•4431 


• 5040 


^4050 


•2046 


•2714 




8* tt 


•4399 


• 5592 


•4626 


•4963 


• 3629 


• 3473 


• 4175 


• A680 


^ .4425 


• 4110 


.0656 


•3940 


•6990 


TO. 1-lSO to 


• 5025 


• 6529 


•5656 


• 6|66 


•4606 


• 3614 


• 4396 


•6366 


• 5307 


•4976 


•1406 


•2490 


• 9010 


TT. l-li2 to 


•3046 


• 3271 


•2606 


• 3226 


.2521 


• 22 72 


• 2367 


• 2626 


•2563 


•3032 


•0591 


•4370 


•2692 


TO. R-212 to 


•4225 . 


•4651 


•3762 


-^4993 


.32 14 


• 3946 


• 3344 


• 35V2 


• 3630 


• 3799 


• 1020 


#1970 


•6899 


Tt. R-220 to 


• 3766 


• 3647 


• 3351 


• 4117 


• 2553 


.2432 


• 2695 


• 3095 


•2660 


.3266 


.0549 


• 1410 


.3130 


RO. R— 111 to 


• 3602 


• 3549 


•2690 


.3553 


• 2894 


• 1997 


• 2390 


•2659 


• 3367 


• 2961 


•0674 


#1439 


.3390 


01. R-212 to 


•4110 


•4405 


•3943 


.4502 


• 3565 


• 2686 


• 3295 


• 4077 


• 3051 


.4120 


•0699 


• 1976 


• 4466 


It. R-333 to 


• 3653 


• 3660 


• 3566 


.4052 


• 2912 


• 2398 


• 2956 


• 3660 


• 3390 


.3564 


• 1279 


• UOl 


• 3629 


tS. R-23t to 


• 3340 


• 3570 


• 3261 


• 3495 


.2758 


• 1682 


• 2404 


• 3109 


• 2966 


•2964 


• 1055 


.1164 


• 3398 


It. R-23S to 


• 3776 


•4016 


•3660 


•4026 


• 3167 


• 2706 


• 3211 


• 3599 


• 3070 


• 4166 


• 0456 


•1140 


.3706 


tS. R-2tO to 


•5162 


• 6179 


• 5452 


• 5904 


• 4776 


• 3719 


• 4455 


• 5260 


•5074 


• 554 7 


.1575 


•2474 


.5689 


H. R-2S0 to 


• 3642 


• 4922 


.4151 


.4359 


• 3917 


• 3222 


• 3569 


• 4223 


. 3656 


• 3613 


• 1537 


•2107 


.6952 


OT. R-2M to 


•2924 


• 3631 


• 3321 


• 3411 


• 3833 


• 2564 


• 2536 


• 3364 


«3261 


.2956 


• 1945 


•2169 


• 6176 


■a. R-2T0 to 


• 2014 


• 2474 


•2062 


• 2032 


• 1982 


• 1753 


• 1530 


• 2037 


• 2134 


• 1730 


• 1036 


.0973 


• 2657 


tt. R-2tl to 


• 1906 


• 3076 


• 2477 


• 2320 


• 2567 


• 1991 


• 2012 


•2496 


• 2164 


•224 3 


• 0796 


• 1097 


• 2826 


to. R-2t2 to 


• 3377 


• 3392 


t2934 


• 3021 


• 2975 


• 2279 


• 2473 


•2981 


• 3075 


•2706 


• 0660 


• 1119 


• 3479 


tl. R-2tO to 


• 43 74 


• 4506 


•4316 


• 4436 


• 3796 


• 3045 


• 3470 


• 4626 


• 3656 


•4066 


• 0969 


• 1799 


.4352 


t2., R-111 to 


•4642 


• 4494 


•4171 


• 4557 


• 3561 


• 2943 


• 3474 


•4223 


• 3706 


• 4073 


•0631 


• 1311 


• 4316 


tl. R-112 to 


• 1640 


• 1441 


• 1321 


.1175 


• 1067 


• 1335 


• 1190 


• 1357 


• 1122 


• 1522 


• 0316 


•0717 


• 1394 


tt. R-333 to 


• 2905 


• 2370 


•2380 


•2653 


• 2239 


• 1466 


• 1635 


•2340 


• ' 106 


•2176 


• 0393 


•0955 


• 2572 


IS. r-tio to 


• 1735 


• 1586 


• 1519 


• 1611 


• 1351 


• 0620 


• 1077 


• 1649 


• 2107 


• 1260 


• 0453 


•0563 * 


• 1728 


tt. F-t20 to 


•2176 


• 2023 


• 1755 


• 2095 


• 1339 


• 1353 


• 1410 


• 1583 


• 1936 


• 1564 


• 0156 


•0671 


• 1641 


tT. r-tio to 


•0997 


• 1467 


•0956* 


• 1097 


• 0964 


• 0617 


• 0454 


• 093^ 


• 1527 


•0516 


• 0526 


•0922 


• 1339 


It. r-tto to 


• 3253 


• 3334 


•2619 


• 3296 


• 2459 


• 2174 


• 2591 


• 2977 


• 2693 


• 2167 


•*.0(H2 


•0626 


• 3484 


H. r«Mi to 



1-8 



TABUS l^l (contlnutd) 





VaviabU 


76 


77 


(0 


79 


80 


81 


82 


U3 


86 


85 


8b 


8/ 




T; R-lOil b3 Vocab. I 


• 5372 


.6531 


• 3710 


.5219 


.6135 


.3622 


.0359 


.6/63 


.6106 


.6662 


.6897 


.9220 




2, R-103 03 UttratuKa 


• 5665 


.6030 


. 3/bh 


.5222 


• 6279 


.3203 


.5016 


.6282 


.3801 


.6715 


.6669 


• 66^U 




R'40<» 63 Music 


• 5366 


.5877 


• ibAl 


.6968 


.6036 


. 3205 


.6709 


.61 76 


.3618 


.6311 


.6056 


.6662 




A. H-105 63 Soc« scud. 


• 6580 


.5562 


• 3M 7 


.6662 


.39A2 


. 3563 


.5006 


.6?6H 


.3670 


.6383 


.6650 


• 6i*ib 




t>» R-106 63 Mach 


• 6763 


.5929 




.51fi9 


.660 1 


.3391 


.5960 


.6692 


.3920 


.5772 


.6608 


• AH03 




b, R‘«107 63 Phya. Scl. 


•6678 


.5856 


.36 7H 


.6o»;3 


.3966 


.3182 


.5366 


.6369 


.3652 


.6785 


.6397 


.6866 




7i R-<108 63 Bio. Sci. 


• 3688 


.6599 


UUb 


• 3690 


.2579 


.2392 


.3917 


.3692 


.2952 


.3627 


.5299 


• 60->3 




a, R-X09 63 Seism. ACC 


• 3906 


.6635 




.3 780 


.2 769 


.26 18 


.6262 


.3628 


.356 1 


.3617 


.5279 


.3875 




9. R«110 63 Aero^Spsca 


• 6805 


• 5396 


.2bb7 


. 38rt9 


• 2836 


.2557 


. 39 76 


.1822 


.2995 


.3676 


.5812 


• 6895 




10. R-lll 63 Eieccrohic 


• 3939 


• 5216 


.261d 


.3712 


.2501 


.2578 


.6277 


.1763 


.306 3 


.3715 


.5135 


.6026 


0 


li. R-1X2 63 Mochaulcs 


• 2966 


• 6166 


. Ui02 


.276v) 


.1021 


.2127 


.290 7 


.3017 


.2525 


.2266 


.3907 


• J886 


3 


32. R**H3 63 Fa vising 


• 2366 


.3086 




.2570 


.2256 


.2000 


.2861 


.2928 


.2355 


.22 75 


.)6i7 


.2722 


H 


X3. R**11A 63 Homs Ec. 


• 3696 


• 3771 


.|6S1 


.27M 


.2075 


.2112 


.2 735 


.2756 


.2282 


.2626 


.3826 


• 3621 


§ 


lA. R-115 63 Spor*i 


• 3B90 


• 6301 


.2H»»*i 




.3016 


.3161 


. 3 766 


.3130 


.3179 


.3663 


.6685 


.302/ 


U 


IS. R-131 63 Arc 


• 5200 


.5717 


.3026 


.6662 


. 3658 


. 35do 


.6138 


. 1928 


.3658 


.3665 


.5806 


• 6706 


a 


16. R-X32 63 UV 


• 6289 


• 5335 


.20 79 


.3585 


. 3 309 


.3210 


.3812 


.1776 


.3199 


.3206 


.5228 


• )901 


N 


17. R-133 63 HsslCh 


•6069 


• 6921 


.2Sbl 


• 61 7 1 


• 3289 


.3660 


.6220 


. 1582 


. U55 


.3665 


.50/2 


.3815 


& 


la. R-13A 63 Engin. 


• 3382 


• 6059 


. 1 7o6 


.2o(>6 


.2058 


.3026 


. 3 lb2 


.3096 


. 266 2 


.2397 


.6061 


• 3506 


19. R-13S 63 Arch. 


• 3563 


.6166 


.2366 


.3179 


.2570 


.2663 


. 3268 


.11C6 


.2588 


.3110 


.6701 


• 36/1 




20. R-138 63 HiUcsry 


• 6057 


.6608 


.2227 


. 3666 


• 3275 


.2976 


.35 36 


. 129 7 


.2826 


. 300 7 


• 6/81 


• 36 1 7 




21. R-139 63 AecC)Busl. 


•B9S6 


.5237 


.2610 


.3382 


.2807 


.3119 


.3722 


. 36 1 


.306 3 


.3057 


• 6728 


• 6103 




22. R*-1A0 63 Frac.Knowl 


• 3601 


• 6267 


.1666 


. 3750 


.2833 


.3117 


.332 3 


.2978 


.2535 


.2097 


.3952 


• 3367 




23. R-1A2 63 Bibls 


• 3896 


.6830 


.3160 


.6019 


. 361 3 


.326 7 


• 6235 


.3861 


.3316 


.6051 


.5589 


.3756 




2A. R-^IAS 63 Huncing 


• 0563 


• 0925 


• 0219 


.0805 


• 0625 


-.0068 


.0190 


.1336 


.066 7 


-•0031 


• 1321 


• 1295 




25. B-XA6 63 Fishing 


• 1736 


• 2763 


.1506 


.2169 


. 1827 


. 1656 


.1829 


.2191 


.1662 


.1538 


.2991 


• 2386 




26. R-1A7 63 Oucdoor 


• 3613 


• 6833 


.26 30 


.3710 


.3206 


.35 70 


. 3720 


.1931 


.3115 


.2969 


.6878 


• 60 3b 




27. R-150 63 Thssccr 


•5818 


• 5688 


.2803 


.66 70 


.3870 


. 3208 


.6208 


.3968 


. 3681 


.3926 


.5601 


.6716 




26. R-162 63 Vocsb. 11 


• 6590 


• 6366 


.3330 


.6566 


.3831 


.3736 


• 6532 


.6569 


.3787 


.3529 


.5816 


•6563 




R-212 63 Ham. Words 


• 2731 


• 3639 


.0066 


.3669 


. 309 5 


.2933 


. 3773 


.2953 


.2566 


.3625 


.62 70 


.3115 




30. R-220 63 Disg. Wds. 


• 6172 


.6821 


.3286 


.5068 


.6361 


.2599 


• 6 389 


.6019 


• 3166 


.6138 


• 5156 


• 3787 


u 


it: R-231 63 Spalling 


• 3511 


.6299 


.31 76 


.6779 


• 6 399 


.3556 


.6968 


.600 1 


• 3135 


.6287 


• 6753 


• 3100 


ft 


32. R-232 63 CapiCsl. 


• 2693 


• 2993 


.2166 


.2889 


.2963 


.3368 


.3631 


.2973 


.2536 


.2560 


.3566 


• 2657 


•s 


33. R-233 63 PuneC. 


• 3938 


• 6902 


. 3506 


.6625 


• 6693 


.6208 


.6605 


.6773 


• 3961 


.5268 


• 5598 


f6082 


•J5 


3A. R^23A 63 Eng. Ussgs 


• 3616 


.6269 


.2869 


.6653 


.6025 


.3682 


.6693 


.5220 


• 3578 


• 6280 


• 6865 


• 38 72 




35. R-235 63 Eff. Exp. 


• 3268 


• 3976 


. 266 7 


• 370l 


.3381 


. 365u 


.6321 


.6361 


.6506 


.3662 


.6727 


• 3531 


S 


R-2A0 63 Word.FuncC 


• 3858 


• 6883 


.3 780 


.6366 


.6318 


.3258 


.5682 


.6106 


.3861 


.6156 


.5652 


• 6080 




37. R-250 63 Rdg. Compr 
36. R-260 63 CrosCivicy 


• 6725 


.5779 


.3565 


.6635 


.6116 


• 6000 


.5203 


.6722 


. 6 38 1 


.6809 


• 7119 


• 5102 




• 6237 


.6805 


.3090 


.6028 


.3025 


.2855 


.6376 


.3706 


.3659 


.3935 


.5600 


• 5691 




39. R-270 63, Msch.Rsss 
AO. R-211 63 Vis. 2 Dia 


• 2896 


• 3832 


.2566 


.3689 


• 1799 


.2335 


.366 3 


.3376 


.2735 


• 3217 


• 6603 


•6268 




• 1966 


• 2371 


.1868 


.2258 


• 1262 


.1691 


.2676 


.1796 


. 1935 


.2365 


.2562 


• 2902 




Al. R-2B2 63 Vis. 3 Di« 


• 2216 


• 3221 


• 2160 


. 260 1 


. .1787 


.1826 


.3151 


.2623 


.2665 


.3011 


• 3666 


• 3792 




A2. R-290 63 AbsC.Rsss 


• 2959 


• 3851 


.2905 


.3620 


.2818 


.2887 


• 6351 


.3662 


.3316 


.3817 


• 6601 


•6112 




TT: R-311 63 AriCh.Rsss 


• 3755 


• 5186 


.3196 


.6260 


• 3555 


.3999 


.5513 


.6528 


• 3892 


.6602 


. 5666 


• 6806 


8 


AA. R-312 63 InC.HSMsCh 


• 3867 


.5137 


.3710 


.6 766 


.659 7 


.6257 


.6078 


• 6666 


.3821 


.5599 


.592 3 


• 6526 


ft 


A5. R-333 63 Adv.HSMsCh 


• 3360 


.6319 


.322 7 


.6101 


' .6008 


.32 16 


.5155 


. 191 7 


.3199 


.5512 


• 5168 


• 3816 




Ab. f-410 63 Arich.Caap 
67. f-620 63 Tsbla Rssd 


• 2095 


.2657 


.1767 


• 2986 


.2088 


.2 7 76 


.3516 


.2706 


• 2267 


.2671 


.3068 


.2061 




• 1181 


• 1070 


.0955 


.1622 


.1636 


.1360 


.1261 


.1216 


• 0921 


.1366 


.1606 


• 1086 




61. f-630 63 Clar.Chaek 


• 1812 


• 2273 


.2007 


.2656 


• 2698 


.15 76 


.2306 


.1530 


• 1286 


• 2257 


.2765 


• 1998 


Ai^.t-AkO t3 Obl.IniD. 


• 1019 


.1357 


• 0982 


.1796 


.1113 


.1167 


.1196 


.1653 


.1087 


.1206 


• 1698 


• 1627 




5^ R-102 60 Vocsb. 1 


•5877 


• 6822 


.3918 


.5661 


.6615 


.396 7 


.5639 


• 6928 


• 6205 


.6880 


.7155 


.5767 




51. R-103 60 LiCsrsCura 


•5662 


• 6126 


.3865 


.5093 


.6 356 


.3389 


.6735 


.6106 


• 3598 


• 6583 


• 6650 


•6851 




52. R-106 60 Music 


• 5326 


• 5639 


.3691 


• 6666 


• '3836 


.3089 


.6652 


• 3580 


.3109 


• 6276 


.5875 


•6501 




53. R-105 60 Soc. SCud. 


•5321 


• 6686 


.3803 


.6701 


.6660 


.6030 


.5362 


.6569 


• 3860 


.6895 


• 7031 


•6812 




5A. R-106 60 Mach 


•6762 


• 5703 


.3897 


.6795 


• 6665 


.3611 


.5575 


.6237j 


• 3706 


.5657 


• 6 160 


• 6979 




55. R-107 60 Phys. Sci. 


• 6632 


• 5706 


.365 7 


.6367 


• 3999 


.3626 


.5066 


.60 76 


• 3656 


.6620 


.6260 


• 6839 




56. R^IOI 60 Bio. Sci. 


• 6080 


• 5272 


• 3229 


.3966 


.3336 


.3021 


.6338 


.3973 


.3192 


.6020 


• 5851 


• 6620 




57. R-*109 60 Scion C. ACC 


• 3811 


.6612 


. 2o 36 


. 3899 


.2995 


. 3066 


.6201 


.3726 


• 3689 


.3502 


.5377 


• 6013 




5g. R-110 60 Aaro-Spsca 


•6796 


• 5370 


.2739 


.3925 


.3088 


.2661 


.6031 


.3619 


.3022 


• 3766 


• 5653 


•6917 




59. R-IU 60 Elsccronic 


.3776 


• 6878 


.2678 


.336 7 


.2593 


.2666 


.3802 


.3207 


.2609 


.3653 


.6937 


• 6769 


u 

s 


60. R-U2 60 Mschsnica 


• 6U7 


• 5160 


.2651 


. 3860 


• 27 35 


.2966 


.3722 


.3766 


.3060 


.2792 


.5008 


• 6805 


61. R-113 60 Fsnaing 


• 3552 


• 6663 


.2639 


. 36 68 


.2976 


.2871 


.3661 


.3591 


.2796 


.2936 


• 6830 


.3757 


d 


62. R-UA 60 Hoat Ec. 


• 3657 


• 6200 


.2223 


. 368 3 


.2636 


. 2 661 


• 3168 


.2903 


.2355 


.2623 


.6199 


• 3769 


0 

T* 


63. R-115 60 Spores 


• 6399 


.5025 


• 3066 


.6225 


• 3766 


.3602 


.6118 


.3653 


• 3360 


.3776 


• 5182 


• 3662 


U 

n 


6A. R -131 60 Arc 


• 5592 


.6529 


• 3271 


.6651 


.366 7 


.3569 


• 6605 


.3868 


.3570 


•6016 


.6179 


•6922 


S 


65. R-132 60 Lsw 


•6826 


• 5858 


.2808 


.3762 


.3351 


.2890 


.396 3 


.3586 


• 3281 


• 3660 


.5652 


•6151 


>§ 


66. R-133 60 HeslCh 


•6963 


• 6388 


.3226 


.6553 


.6117 


.3553 


• 6502 


• 6052 


.3695 


• 6028 


• 5906 


• 6359 




67. R-13A 60 Engin. 


• 5829 


.6806 


.2521 


.3216 


.2553 


. .2896 


.3565 


.2912 


.2 758 


• 3167 


• 6776 


• 3917 




69. R-135 60 Arch. 


• 5673 


.3816 


• 2272 


.3668 


.2632 


.1997 


.2686 


.2396 


.1802 


• 2708 


.3719 


• 3222 




69. R-138 60 NillCsry 


•6175 


• 6398 


.2367 


.3366 


• 2895 


.2 390 


.3295 


.2956 


.2606 


.3211 


• 6655 


• 3589 




70. R-139 60 AceC.Busi. 


•6860 


• 6388 


.2626 


.3592 


.3095 


.2859 


.6077 


.3680 


• 3109 


.3599 


.5280 


• 6223 




71. R-IAO 60 Prsc.Knowl 


• 6625 


• 5307 


• 2563 


.38 30 


• 2089 


• 3367 


• 3951 


.3390 


• 2986 


• 3070 


.5076 


• 3858 




72. R-1A2 60 Bible 


•6110 


• 6978 


.3032 


• 3 799 


.3266 


.2981 


.6120 


• 3566 


• 2986 


• 6166 


• 5567 


.3813 




73b R-1A5 60 Huncing 


•0658 


• 1606 


• 0591 


. 1020 


.0563 


.0676 


.0693 


.1273 


• 1055 


• 0658 


• 1575 


• 1537 




7A. R-1A6 60 Fishing 


• 1568 


• 2650 


• 1370 


.1970 


.1610 


.1635 


.1578 


.1601 


• 1186 


• 1160 


• 2676 


.2107 






• 6556 


• 5916 


• 2672 


.6055 


• 3136 


.3350 


.6166 


.3629 


• 3358 


.3706 


• 5689 


•6552 






• 6263 


c2926 


.6696 


.3 799 


.3102 


.6208 


.3760 


.3258 


.38 35 


.5730 


• 6665 




77. R-162 60 Vocsb. 11 


• 6263 




.362 7 


.5162 


• 6270 


.3680 * 


.5260 


.6506 


.6067 


• 6586 


.6765 


• 5055 




78. R-212 60 Men. Words 


• 2926 


.3627 




• 3395 


.3522 


.2863 


.3926 


.3115 


.2716 


.3582 


• 6252 


• 3002 


u 


79. R-220 60 Disg. Wds. 


• 6696 


• 5162 


.3;l95 




• 6951 


.3660 


.6956 


• 6656 


• 3506 


.6503 


• 5766 


.6617 


(• 


W* R-231 60 Spelling 


^ ^3799 


• 6270 


.3522 


.6951 




.3861 


.536 7 


.6337 


.3506 


• 6302 


• 6933 


• 3303 


H 


81. R-232 60 CspiCsl. 


• 3102 


• 3680 


.2863 


.3660 


. 3861 




.6766 


.6196 


.3509 


.3170 


• 6609 


.3161 


*5 


82. R-233 60 PuneC. 


• 6208 


• 5260 


.3926 


.6956 


• 5367 


.6766 




.5358 


.6566 


• 5586 


• 6017 


• 6396 


t4 

1^ 


83. R-23A 60 Eng. Usage 


• 3760 


• 6506 


.3115 


.6656 


• 6337 


.6196 


.5358 




• 6505 


.6020 


• 5227 


• 3895 


s 


8A. R-235 60 Eff. Exp. 


• 3258 


• 6067 


.2716 


.3506 


.3506 


.35C9 


• 6566 


.6505 




^3697 


• 5019 


• 36 70 


R-2A0 60 Word.FuncC 


• 3835 


• 6586 


• 3582 


.6503 


• <*302 


.31 70 


.5586 


.6020 


• 3697 




• 5838 


• 6581 




86. R-250 60 Rdg. Compr 


• 5730 


• 6765 


.6252 


• 5 766 


.6933 


.6609 


.6017 


.522/ 


.5019 


.5838 




.6237 




87. R-260 60 CreaCiviCy 


• 6665 


.5055 


.3002 


.6617 


.3303 


.3161 


.6396 


‘ .3895 


.3670 


• 6561 


• 6237 






88. R-270 60 Mech.Reas 


• 3292 


• 6236 


.2668 


.6115 


• 21bl 


.2917 


«6105 


.3 700 


.3156 


.3956 


.5263 


• 5150 




89. R-28X 60 Vis. 2 Dim 


• 2022 


.2613 


.1598 


. 3039 


• 1389 


.1810 


• 266 1 


.2261 


.2058 


.2635 


.3119 


• 3210 




90. R-282 60 Vis.* 3 Dim 


.2607 


• 3135 


.2032 


.2825 


.1390 


.1906 


.3303 


.2662 


.2281 


.3355 


.3866 


• 6120 




91. R-290 60 AbsC^Reas 


• 3123 


• 3882 


.2926 


.3693 


• 2660 


• 3036 


.6538 


.3386 


.3561 


.6257 


• 5036 


• 6365 


U 


W* R-311 60 Arich.Reas 


• 6066 


• 5357 


.3563 


.6236 


• 6101 


.3820 


.5735 


• 6720 


.6235 


• 5368 


.6012 


• 6956 


>A 


93. K-3X2 60 Int.HSMath 


•6309 


.5172 


.3856 


.6601 


.6719 


.3958 


.7j099 


.6685 


.3993 


.5790 


• 5969 


•6625 


H 


9A. R-333 60 Adv.HSMaCh 


.1350 


• U06 


.1560 


.1520 


• 16H0 


• 1121 


.1766 


.1179 


.0958 


• 1866 


• ^562 


• 1656 




95. F-AIO 60 AriCh. Corap 


• 2685 


• 2833 


.1978 


.2337 


.3060 


• 2956 


.3.362 


.2852 


.2868 


• 2758 


• 3563 


• 2258 




96. F-A20 60 Table 


• 1616 


• 2026 


.0916 


.2C30 


.1815 


• 1968 


.2271 


.1869 


.1889 


.1786 


.2385 


• 1866 




97. F-A30 60 Cler. Check 


• 1891 


• 2197 


.1611 


.3301 


.2956 


.1831 


.2679 


.1901 


• 1866 


.2669 


.2787 


• 1968 




98. F-AAO 60 Obj.lnsp. 


• 0938 


• 1298 


.0968 


.2C36 


.08 36 


.0961 


.1325 


.0921 


• 1170 


.12/1 


.1555 


• 1818 




99. F*801 60 Socioecon. 


.3382 


.3736 


. 1868 


.2 760 


.2026 


.1922 


.2722 


.2571 


.2166 


.2969 


• 3061 


• 3065 







1-9 



TABLE l**l (continued) 



gg 


HU 


90 


)1 


9<? 




96 


/*> 


96 


9/ 


9 1 


99 


Variable 


• b3|2 


• ili/U 


.3631 


.62/8 


• ,*5 56 


.535/ 


.150? 


. 3051 


.199/ 


• 1865 


• 1663 


• 3717 


I. 8-102 63 


• A02? 


. 1,^696 


. 3C (8 


#359/ 


.6856 


.5622 


.1355 


.2595 


• 1711 


• 1966 


.16/5 


• 3663 


2. 8-103 63 


• A129 


• / 


• 1 ) 66 


.3/62 


.652) 


• 6M)3 


• 168/ 


• 2/66 


• U.69 


. '036 


• 136/ 


• 3929 


3. B-I04 63 


• A299 




• M 1 9 


. 389/} 


• 51 H 


• 5tM6 


• 16/3 


.3105 


.195/ 


• 1 /6l 


.136/ 


• 2618 


A. 8-105 63 


• ti070 




.6l(>3 


• 50 1 5 


.0269 


• UB6 ^ 


.1992 


.329 3 


.205/ 


• 2?7U 


• 16^3 


• 6062 


5. 8-106 63 




• 3(^hl 


• 60U6 


• <f6t I 


• 5 7(k 


. i 5 


.1/65 


.3072 


.17/3 


• I860 


• l6ort 


• 3683 


6. 8-107 63 


• AA16 




.29.30 


• 3)6H 


• 6 2 9 3 


• )9 t ) 


. 1386 


• 1836 


.1093 


.09/0 


• 11?2 


.2232 


7. 8-108 63 


• A060 


.;^66H 


.2995 


.3/69 


• 6 5o6 


.6690 


.1305 


• 2 326 


• 1 6u 1 


• 1696 


• 165‘> 


• 2682 


8. 8-109 63 


• ^330 




. J6 30 


. 3793 


• 6529 


.6220 


.1366 


• 20U0 


• 1698 


• 1502 


• 1 6‘>d 


• 31/2 


9. 8-110 63 


• 6137 




• 6610 


• )9Mh 


.6806 


.633/ 


.1656 


.2116 


• r3:>6 


• 0935 


.1158 


• ?991 


10. 8-111 63 


• bloa 


• 26(1 i 


• 3180 


.2835 


• 3513 


• 2/fl7 


• 0/9i. 


• 15/2 


• 0969 


• 0669 


.118/ 


.2165 


11. R-112 63 


• 3630 


. t 3 


.l9o2 


.22 36 


.29)6 


• 2(n;‘3 


.0536 


• ldl5 


.1217 


.09/6 


• 083/ 


.0673 


12. 8-113 63 


.3466 


. 


• 2567 


• 256 3 


.31/2 


.3061 


.0951 


.1861 


.1258 


.0/66 


• 1028 


• 2109 


13. 8-114 63 


• 2611 


. 1 6h ^ 


.1632 


• 2H81 


• )8H2 


• 60i(6 


.1296 


• 3051 


• 1905 


• 1898 


• 1012 


• 2/96 


14. 8-115 63 


.3982 


.?I67 


.2/:>3 


• 3633 


.3956 


.6361 


.1283 


.2391 


.166? 


.1515 


.1 335 


. 3359 


15. 8-131 63 


• 3520 




.2 388 


.2 


• 66 58 


• 6?dl 


.1250 


.2111 


• 15/d 


. 1361 


• 09d2 


.2900 


16. 8-132 63 


.3833 


• 2316 


.2560 


.2//5 


• )H2r! 


• 3960 


.1080 


• 2268 


• 1558 


. 1 390 


.1160 


.277/ 


17. 8-133 63 


• 3674 


. 1 i 


.231 1 


.26( i 


.3229 


.3112 


.0/05 


.2181 


. 1669 


.0902 


• 0932 


• 2068 


18. R-134 63 


.3629 


.1827 


.2765 


• 2 92 5 


• )585 


• 3/66 


.1112 


. 1 /03 


.0759 


• l?01 


.1023 


.2736 


19. R-135 63 


• 2780 


^1520 


.2162 


• 2 266 


• 3529 


• 3609 


.0690 


• 2028 


• lldB 


• 16/6 


• 0615 


• 2666 


20. R-138 63 


.3267 


• 1803 


.2 309 


.2/51 


.63/6 


• 3866 


• 0618 


• 2 366 


.1/53 


• 1525 


• 09(j2 


• 2968 


21. R-139 63 


• 2786 


• 1868 


.1837 


.22K7 


• 2H16 


.3211 


• 0698 


• 2138 


• 2015 


.1 /28 


.139/ 


• 2266 


22. 8-140 63 


• 3228 


.1212 


• 2268 


.1139 


• 6 1 19 


• 6305 


.0596 


• 21/6 


.1108 


.1315 


• 0616 


• 2066 


23. 8-142 63 


.2003 


• 089/ 


.1093 


.U6/7 


• 0686 


• u6/l 


• 0009 


• 0337 


-.0355 


-.0695 


• 0552 


-.0573 


24. 8-145 63 


• 2505 


• 1006 


• 16 32 


. 1 195 


.2207 


.195/ 


• 0826 


.1616 


.0830 


• 06 76 


.0863 


• 0862 


25. 8-146 63 


.6058 


• 2082 


• 26u9 


.3098 


• 3729 


.6128 


.0/97 


.2280 


.1616 


• 1122 


• 106/ 


• 3268 


26. 8-147 63 


.3596 


• ?32(> 


.2222 


.2952 


.6015 


.626 1 


• 0669 


• 23/6 


.1/69 


• 1/30 


.1226 


• 3264 


27. 8-150 63 


.6167 


• 2660 


.2906 


• 3395 


• 6686 


.6666 


.0862 


• 2620 


• 1866 


.1650 


.1295 


• 3565 


28. 8-162 63 


• 2628 


• 203*» 


.2065 . 


• .3188 


• 3225 


• 3566 


.0905 


.1923 


.15/5 


. 1961 


.0663 


. 1355 


29. 8-212 63 


.3674 


• 2702 


.2 580 


. 3296 


.3988 


• 3987 


.1226 


• 1918 


.1676 


.2610 


• 1602 


.3160 


30. 8-220 63 


.1711 


• 1038 


.1161 


.257/ 


• )6/5 


• 6666 


• 0/98 


.2558 


• 2059 


• 30/6 


• 0996 


.1715 


31. 8-231 63 


• 2110 


• 1763 


• 1662 


• 2632 


• 26/'3 


• 2968 


• 066C 


.1960 


.2112 


• 2066 


.06/6 


• 1386 


32. 8-232 63 


• 3767 


• 2511 


• 2917 


.6275 


.5226 


• 5696 


• 1616 


• 2563 


.2293 


• 26/6 


.1033 


• 2496 


33. 8-233 63 


• 2991 


• 1665 


.1765 


• 3000 


• 3815 


• 392 / 


.0805 


.2136 


.16/6 


• 1935 


• 0809 


• 2366 


34. 8-234 63 


• 2851 


• 1810 


• 2178 


.3206 


• 3926 


• 3762 


.0632 


.2379 


.2133 


.2129 


• 0886 


• 2297 


35. 8-235 63 


.3825 


.2731 


.355) 


.6202 


.5512 


.5816 


.1565 


• 2905 


.2092 


• 2526 


.1612 


.3231 


36. 8-240 63 


• 6538 


• 2861 


• 3522 


• 66/7 


.5535 


• 5355 


.1530 


• 3050 


• 2036 


.2256 


• 1365 


• 3265 


37. 8-250 63 


• 6864 


• 3302 


• 3986 


• 6096 


• 6653 


• 6519 


• 1302 


• 2556 


.1706 


• 1600 


• 1580 


• 2863 


38. 8-260 63 


• 4581 


.3986 


• 6901 


• 6656 


• 6371 


• 6125 


.1336 


• 1888 


.1669 


• 1232 


• 1566 


• 2928 


39. 8-270 63 


•6182 


• 69l5 


.6169 


.3815 


• 2025 


• 3006 


• 099/ 


• 1626 


• 1691 


.1186 


• 1892 


• 1887 


40. 8-281 63 


• 5215 


. 3006 


• 6007 


• 6396 


• 3961 


• 3899 


.1680 


.2066 


.1821 


• 1587 


• 2096 


.2166 


41. 8-282 63 


.6772 


.3669 


• 6588 


.5678 


• 65 76 


.6723 


.1276 


• 2669 


• 1989 


.1968 


• 1766 


• 2822 


42. 8-290 63 


• 6588 


.2757 


• 3610 


.6981 


• 6506 


.5667 


.15/6 


.3393 


.2332 


.2016 


• 0962 


.3204 


43. 8-311 63 


•6310 


• 2H/6 


.3753 


• 5007 


• 6259 


• 68/5 


.2057 


• 330/ 


• 2360 


• ?6l9 


• 1361 


• 3301 


44. 8-312 63 


• 3830 


• 2389 


.3626 


.6260 


• 5631 


• 6206 


• 2291 


• 2600 


• 1700 


. .2162 


• 0962 


• 3193 


45. 8-333 63 


• 1678 


• 1960 


nl2l0 


.2567 


• 3052 


.3306 


.0692 


• 6653 


.2767 


• 2768 


• 1355 


• 1271 


46. r-410 63 


• 1053 


• 1298 


.0867 


• 1263 


.1219 


• 1763 


• 0666 


• 1126 


• 1553 


• 1/99 


.1661 


.1662 


47. r-420 63 


.1422 


.1799 


.0926 


. 1695 


• 1863 


.2250 


.0615 


• 1635 


• 1601 


• 2703 


• 1651 


.1788 


48. r-430 63 


• 2247 


.2557 


• 2009 


.2182 


.1161 


• 1260 


• 0366 


.1601 


.1662 


• 1768 


• 2866 


• 1264 


49. r-440 63 


• 5131 


.2926 


• 3592 


.6266 


• 5860 


.5595 


• 1750 


• 2950 


• 1657 


.2068 


• 1236 


• 6128 


50. 8-102 60 


• 5451 


.2202 


.28/8 


.3679 


.6763 


• 5132 


.1790 


• 2368 


• 1526 


.2085 


• 1235 


• 3826 


51. 8-103 60 


• 3438 


• 2069 


.2852 


• 3616 


.6332 


• 6/95 


.152/ 


• 2262 


• 1506 


• 1663 


• 1193 


• 3856 


52. 8-104 60 


• 6176 


• 2256 


.3176 


• 6221 


.5653 


• 5696 


• 1580 


.3126 


• 1/88 


.2073 


• 0967 


• 3774 


53. 8-105 60 


• 6588 


• 2819 


.3913 


.6803 


.6069 


• 6815 


• 2566 


• 2866 


• 1697 


• ^266 


.1013 


• 3764 


54. 8-106 60 


• 6888 


• 2610 


• 360/i 


• 6220 


.5507 


.5336 


.1709 


• 2526 


• 1 626 


• 1851 


• 09 76 


.3207 


55. 8-107 60 


• 6601 


• 2038 


• 291^/8 


• 36e2 


• 6655 


.6603 


.1266 


.1968 


• 1616 


• 1616 


• 0962 


.2615 


56. 8-108 60 


• 3734 


• 22 36 


.2718 


.37'»H 


.6672 


• 6163 


• 1268 


• 2302 


.1560 


• 1/25 


• 1013 


• 2877 


S7» 8-109 60 


• 6818 


• 2366 


• 3666 


.3625 


• 66 36 


• 6263 


.1563 


• 1/62 


• 1096 


• 13/3 


• 0955 


• 3363 


58. 8-110 60 


• 5255 


• 2661 


.3536 


• 3635 


.658/ 


• 3988 


• 16/6 


.1707 


• 0956 


• 0928 


•0635 


• 2989 


59. 8-111 60 


• 5023 


• 2556 


.31 76 


• 3166 


.6350 


.3736 


• 1296 


.1871 


• 1169 


• 1066 


• 1033 


• 2837 


60. 8-112 40 


• 3760 


• 20 76 


.23 79 


• 2888 


• 3870 


.3620 


• 0896 


• 2220 


• 1391 


• 1266 


• 0610 


• 1799 


61. 8-113 M 


• 3206 


• 1963 


o2602 


• 2668 


• 36 36 


• 336/ 


.1093 


.1860 


.1219 


• 1196 


• 0803 


• 2211 


62. 8-114 60 


• 2826 


.2016 


• 1908 


.3377 


.6376 


.6662 


.1668 


• 2905 


• 1735 


• 2176 


.0997 


• 3293 


63. 8-115 60 


• 3831 


.26 76 


• 3078 


.3392 


• 6506 


.6696 


• 1661 


• 2370 


• 1586 


• 2023 


• 1667 


• 3336 


64. 8-131 60 


• 3321 


•2062 


.2677 


• a936 


• 6316 


• 61/1 


• 1321 


• 2380 


• 1519 


• 1755 


• 0954 


• 2819 


65. 8-132 60 


• 3611 


.2032 


• 2320 


.3021 


• 66 36 


.6557 


.1175 


• 2653 


• 1811 


.2095 


• 1097 


• 3298 


66. 8-133 60 


• 3833 


• 1982 


• 2567 


• 2975 


• 3798 


• 3561 


.106/ 


.2239 


.1351 


• 1339 


• 0986 


• 2659 


67. 8-134 60 


• 2546 


• 1753 


• 1991 


• 2279 


.3065 


• 2963 


• 1335 


• 1666 


• 0620 


• 1353 


.041/ 


• 2176 


68^ 8-135 60 


• 2534 


• 1530 


.2012 


• 2673 


• 36/0 


• 36 76 


.1190 


• 1635 


• 10/7 


• 1610 


• 0656 


• 2591 


69. 8-138 60 


• 3346 


• 2037 


• 26<KS 


• 2981 


• 6626 


• 6223 


• 135/ 


• 2 360 


• 1869 


• 1583 


• 0935 


• 2977 


70. 8-139 60 


• 3281 


• 2136 


• 2iB6 


• 3075 


.3856 


.3708 


.1122 


• 2906 


• 2107 


• 1938 


• 1527 


• 2693 


71. 8-140 60 


• 2858 


• 1 730 


»2263 


• 2/06 


• 6068 


• 6073 


.1522 


• 2176 


.1260 


.1566 


• 0536 


• 2187 


72. 8-142 60 


• 1865 


.1036 


• 0 798 


• 0660 


• 0983 


• 0631 


.0316 


• 0393 


• 0653 


• 0158 


.0528 


-•0062 


73. 8-145 60 


.2188 


.0973 


• 1057 


.1115 


.1799 


• 1331 


.0717 


.0955 


• 0563 


• 0871 


.0922 


• 0428 


74. 8-146 60 


• 6176 


.2657 


• 2826 


.3679 


.6352 


• 6316 


• 1396 


.2572 


• 1/28 


• 1661 


• 1339 


• 3686 


38 


• 3292 


• 2022 


• 2607 


.3123 


• 6066 


• 6309 


• 1350 


• 2685 


• 1616 


• 1891 


• 0938 


• 3382 




• 6234 


• 2613 


• 3135 


• 3882 


• 535/ 


• 51/2 


.1606 


• 2833 


• 2026 


• 2197 


• 1296 


• 3736 


//• ■— 10a OU 
7a 7 an 


.2648 


.1598 


• 2032 


• 2926 


• 3563 


.3856 


.1560 


.1978 


• 0916 


• 1611 


• 0966 


• L868 


/a. K— AftA DU 
71 i_77n An 


• 6115 


• 3039 


.2825 


• 3693 


• 6236 


.6601 


.1520 


.2337 


• 2030 


• 3351 


• 2036 


• 2760 


78. R— 22U OU 
in 1 771 An 


• 2181 


.1389 


• 1398 


• 2660 


.6101 


.6719 


.1660 


• ?i060 


• 1815 


• 2956 


• 0836 


• 2024 


all . R*”2 Ji all 

11 ■ 7 77 An 


• 2917 


.1810 


• 1906 


• 3036 


• 3820 


.3958 


• 1121 


• 2956 


.1968 


• 1831 


• 0961 


• 1922 


■1. 8-232 aO 

17 ■ 777 An 


.6105 


.2661 


• 3303 


• 6538 


.5735 


• 6099 


.1/66 


• 3362 


.2271 


• 2479 


.1325 


• 2722 


■2* 8-233 aO 


• 3700 


• 2261 


• 2662 


.3386 


• 6720 


.6685 


.11/9 


• 2852 


.1869 


• 1901 


.0921 


• 2971 


■3. 8-234 60 

ll ■ 7 7C An 


.3156 


.2058 


• 2281 


• 3561 


• 62 35 


.399 3 


• 0958 


.2868 


• 1889 


• 1866 


.1170 


• 2144 


aa. 8-233 OU 


• 3956 


.2635 


.3355 


• 625/ 


.5368 


• 5/90 


• 1866 


.2758 


• 1766 


.2669 


• 12/1 


• 2969 


85. 8-240 60 


.5263 


• ni9 


• 3866 


.5036 


• 6012 


.5969 


• 1562 


.3563 


• 2385 


.2787 


• 1555 


.3941 


86. 8-250 60 


.5150 


.3210 


• 6120 


.6365 


.6956 


.6625 


• 1656 


.2258 


• 1866 


.1968 


.1618 


• 3049 


87 a R**260 60 




• 6725 


.5 706 


• 5282 


• 6769 


.6666 


.1502 


.2030 


• 16/1 


• 1389 


• 2037 


• 2497 


88. 8—270 60 


• 6725 




• 6688 


• 3B86 


• 291/ 


.2816 


• 0616 


• 1931 


.2206 


• 1960 


.2926 


.1659 


89 a R^261 60 


• 5704 


.6688 




• 5061 


• 6086 


• 3760 


.1269 


.1/09 


• 1696 


• 1330 


• 2167 


• 2153 


90. 8-262 60 


.5202 


• 3386 


• 5061 




• 686/ 


.6862 


.1621 


• 2986 


• 2181 


.2166 


• 1996 


• 2857 


91. 8-290 60 


• 6 768 


.2917 


.6086 


• 6887 




.6390 


• 1665 


.3622 


• 1866 


• 1860 


• 1090 


• 3308 


92. 8-311 60 


.6664 


./:H16 


• 3760 


• 6862 


• 6390 




.2660 


• 3506 


• 1830 


.2215 


.1123 


• 3299 


93* 8"*312 60 


• 1502 


• 0816 


.1269 


.1621 


.1885 


• 2660 




.0671 


-.0066 


• 0267 


-.0068 


• 0830 


94. 8-333 60, 


• 2030 


• 1931 


• 1 709 


• 2986 


• 3622 


.3506 


.0671 




.3037 


.2956 


.1351 


.1282 


95. r-410 60 


• 1471 


.2206 


.1696 


.2181 


• 1R66 


.1830 


-.0066 


.303 7 




• 3568 


• 36/9 


• 1158 


96 • F-420 60 


• 1388 


• 1960 


• 13 )0 


• 2166 


.1060 


• 2215 


• 0267 


.2956 


.3566 




• 3252 


.1110 


97. r-430 60 


.2037 


• 2926 


.216/ 


• 199B 


• 1090 


• 1123 


‘".0068 


.1351 


.36/9 


• 3252 




• 1115 


98. r-440 60 


• 2457 


• 1659 


• 2151 


• 2857 


• 33C0 


.3299 


• 0830 


• 1282 


• 1156 


.1110 


• Ills 




99. r *801 60 



*Eech correletlon In thle table le beeed on ell ceeee hiving 
villd icorii for both of tho viriiblii corrilitid* 

^The unweighted numbers of ciiii on which iich correlation 
co^.fflclent la baaed may be detamlned form Table 2-5* 



1 



I“10 

TABLE 1-2 • Pseudo-matrix^ of correlations based on females^ 



H 

I 

s 



J1 tf 

IS 



Variable 

T. R^102 63 Voeab. I 

2, R-103 63 Llceracura 

3. R-106 63 Music 
6. R-IOS 63 Soc, scud. 

5. R-106 63 Mach 

6. R-107 63 Phya.. Scl. 

7. R-108 63 Bio. Scl. 

8. R-109 63 SclenC.Acc 

9. R-110 63 Aero-Spaca 

10. R-111 63 Elaccronlc 

11. R-112 63 Mechanlca 

12. R-113 63 Fanning 

13. R-116 63 Home Ec. 

16, R-llS 63 Sporca 

15. R-131 63 Arc 

16. R-132 63 Law 

17. R-133 63 Healch 

18. R-136 63 Engln. 

19. R-13S 63 Arch. 

20. R-138 63 Mlllcary 

21. R-139 63 Accc,Bual. 

22. R-160 63 Prac.Knowl 

23. R-162 63 Blbla 
26. R-16S 63 Hunclng 

25. R-166 63 Flahlng 

26. X-167 63 Outdoor 

27. R-ISO 63 Thaacar 

28. R-162 63 Vocab. II 

29. R-212 63 Hem. Worda 
u 30. R-220 63 Dlag. Wda. 
srar R-231 63 Spalling 

32. R-232 63 Caplcal. 

33. R-233 63 PuncC. 

36. R-236 63 Eng. Uaaga 
35. R-23S 63 Eff. Exp. 
TT. R-260 63 Word.Funcc 

37. R-2S0 63 Rdg. Compr 

38. R-260 63 Craaclvlcy 

39. R-270 63 Hech.Raaa 

60. R-2S1 63 Via. 2 Dim 

61. R-262 63 Via. 3 Dim 

62. R-290 63 Abac.Raaa 
W. R-311 63 Arlch.Raaa 
66. R-312 63 Inc.MSMach 

65. R-333 63 Adv.HSMach 

66. r-610 63 Arlch.Comp 

67. r-620 63 Tabla Xaad 

68. r-630 63 Clar.Chack 
^ r-660 63 OkJ.Inap. 
n? R-102 60 Vocab. 1 

51. R-103 60 Llcaracura 

52. R-106 60 Mualc 

53. R-105 60 Soc. Scud. 
56. R-106 60 Mach 

55. R-107 60 Phya. Scl. 

56. R-IOS 60 Bio. Scl. 

57. R-109 60 Sclanc.Act 

58. R-110 60 Aaro-Spaca 

59. R-111 60 Elaccronlc 

60. R-112 60 Machanlca 

61. R-113 60 Faming 

62. R-116 60 Hona Ec. 

63. R-llS 60 Sporca 
66. R-131 60 Arc 

65. R-132 60 UW 

66. R-133 60 Healch 

67. R-136 60 Engln. 

66. R-13S 60 Arch. 

69. R-138 60 Mlllcary 

70. R-139 60 Accc.Bual. 

71. R-160 60 Prac.Knowl 

72. R-162 60 Bible 

73. R-165 60 Hunclng 
76. R-166 60 Flahlng 

SIS a 



X U 



eater 

TJ, R-162 60 Vocab. II 

78. R-212 60 Hem. Worda 

79. R-220 60 Dlag. Wda. 

80. R-231 60 Spelling 

81. R-232 60 Capital. 

82. R-233 60 Puncc. 

63. R-236 60 Eng. Uaage 
,86. R-23S 60 Eff. Exp. 
b5. r- 260 60 Word.Funcc 

86. R-2S0 60 Rdg. Conpr 

87. R-260 60 Creativity 

88. R-270 60 Mech.Reaa 

89. R-281 60 Via. 2 Dim 

90. R-282 60 Via.' 3 Dim 

91. R-290 60 Abac. Reas 
R-311 60 Arlch.Reas 

93. R-312 60 Int.HSMach 
96. R-333 60 Adv.HSMach 
». F-610 60 Arlch.Comp 

96. F-620 60 Tabla Read 

97. F-630 60 Clar. Check 

98. F-660 60 Obj.Inap. 

99 . P*801 60 Socloacon. 



o 

ERIC 






I 



.7316 


• 7MH 


• 0693 


• 65U 




• 7?6H 


• 066 1 


.6591 


• 7171 


• 66 30 


• OOHb 


• 5922 


• b6S0 


• 6HB6 


• ^970 


.6666 


• <»907 


.6ldb 


• bOS3 


.396 9 


• •>769 


• 5066 


• A681 


• 3fH6 


• 6696 


• 5132 


• 0731 


.6269 


• !>6/7 - 


.5669 


• b603 


• 53fC 


• 656^ 


• 3966 


• 6266 


.62^6 


• 660H 


• 63HO 


• 6162 


• 559C 


• 6692 


• 6286 


• r>3l6 


.5565 


• 11^1 


• 0502 


• 0560 


• 0665 


• 5530 


.5125 


• 696? 


• 6666 


• 7179 


• 6513 


• 61.36 


• 392 7 


• 5176 


• 6861 


• 6596 


• 6801 


• 3279 


• 3667 


• 5667 


• 6283 


• 50S5 


• 5106 


• 6675 


• 6669 


• 5599 


• 5551 


• 6919 


• 6836 


• 5600 


.5278 


• 5223 


• 6237 


• 2916 


• 2366 


• 6653 


• 3762 


• 5123 


• 6560 


• 6360 


• 5532 


• 5520 


• 5676 


• 3516 


• 3870 


• 3907 


.2895 


• 2915 


• 2007 


• 2400 


• 1938 


• 3035 


.2059 


• 7461 


:#6729 


• 4216 


• 71B2 


•4127 


• 5966 


• 1004 


• 4908 


• 5767 


• 5660 


•6032 


• 5600 


• 5311 


• 5162 


• 5040 


.6699 


• 6041 


• 3906 


• 1451 


.3195 


•6372 


• 3557 


• 5505 


• 6935 


;6oio 


.6277 


• 6924 


• 6669 


•4662 


• 6192 


•6676 


• 6366 


• 5S79 


• 5626 


• 6225 


• 3540 


• 3607 


• 3325 


• 2933 


• 2686 


• 5542 


• 5296 


•6362 


.3877 


•6769 


• 5233 


• 1077 


• 0395 


• 0567 


.0570 


• 5600 


• 6751 


• 5696 


.5796 


• 6776 


.6336 


• 6369 


• 6360 


• 5508 


*6956 


• 6667 


• 6659 


• 3739 


• 3669 


• 5963 


. .5706 


• 6691 


• 6835 


• 6311 


• 6302 


• 5516 


• 55C1 


• 7660 


.7079 


• r>353 


.67 36 


• 6966 


• 6030 


•3367. 


• 2889 


• 3930 


• 3360 


• r>136 


• 6365 


• 6123 


• 5663 


• 5892 


.5710 


• 1170 


• 0367 


• 3336 


. 305 7 


• 2015 


• 19«)5 


• 1869 


.1959 


• 2136 


• 2CC0 


• 6269 


• 6361 



4 



.66 H 


.722 4 


.6513 


. 726M 






.6 406 




• 5 5 7 6 


.(jMO 


.5 ViM 




.»160 




.6036 


• 6 )''6 


.6 4 




.6132 


• 6666 


.6 109 


. 3965 


.665 4 


. 527 i 6 


.60d5 


.6152 


.5176 


.5202 


. >706 


.5 762 


• 5.*96 


. 571 -.; 


.5220 


.5225 


.6169 


. 3 7 7 7 


.6193 


.6158 


.6179 


.66d2 


. 56/6 


.6237 


.6053 


• 6105 


.6839 


.5 306 


• 0626 


. 1 188 


.0781 


.0667 


• 6801 


.5066 


.6377 


.61 36 


• 6158 


.6 502 


• 3661 


.3901 


.6653 


• 612 C 


• 3581 


• 6215 


.2707 


• 3230 


• 6 >83 


.5789 


.3 797 


.6660 


• 3921 


• 6691 


• 6961 


.5737 


• 6130 


.6952 


• 6393 


.6759 


• 6295 


• 6306 


• 2302 


• 2621 


..3639 


• 3630 


• 6258 


• 6650 


• 6908 


. .5935 


.6988 


.5837 


• 3326 


• 3690 


• 3226 


• 36 36 


• 1981 


• 2267 


• 1355 


• 2157 


• 2187 


• 2027 


• 6386 


.6570 


.5769 


• 6019 


• 761 ^ 


• 5870 


• 6178 


• 7971 


• 5020 


• 5661 


• 6987 


.5969 


• 6516 


• 5175 


• 618^ 


.6676 


.3577 


• 3728 


• 2772 


• 3362 


• 3601 


• 3563 


• 6650 


• 5092 


• 6300 


• 6250 


• 665 B 


• 6761 


.5751 


• 5722 


• 3936 


• 6179 


• 5020 


• 5291 


.3813 


• 3569 


• 3026 


• 3366 


• 2806 


• 2919 


• 6688 


• 5253 


• 3565 


• 6037 


• 6296 


• 5057 


• 0513 


• 0936 


• 0566 


• 0510 


• 6831 


.6755 


• 536 ? 


.5232 


• 5901 


• 6166 


.3779 


• 6266 


’ .6963 


• 666C 


• 3878 


• 6159 


.3216 


• 362 7 


.5075 


.5616 


.6069 


• 6692 


• 3686 


• 3910 


.6 372 


.5195 


.6259 


• 7j95H 


.6569 


.6569 


.6105 


• 6153 


• 2 766 


• 3006 


.3185 


.3536 


• 6322 


.6568 


• 6985 


• 5696 


.‘•a'li 


• 5635 


.1011 


.0969 


. 1)11 


• 3220 


. IH*9 


• 1 68 1 


.ion 


• 16>6 


./ma 


• 1726 


.*0 


.3991 








6 


7 


8 


9 


1 . 


• 666 1 


. 7 1 n 


• 60H5 


.•>650 


.6976 


.69. : 


.659! 


• 663C 


.5922 


.6806 


.6668 


• 61 • * 


.6576 


.5958 


• 5160 


• 6536 


.6308 


.6! K 


.6310 


.6932 


.5958 


• 6926 


.6650 


.66^' 




. 7205 


.5369 


• 6619 


.6508 


.6 7^ 


. 7205 




.6365 


• 6691 


.5260 


.59 


.5 369 


• 6365 




.6 306 


• 6679 


.6^'* ,‘ 


.6619 


• 6691 


• 6 306 




. 3791 


.32 * ' 


• 6500 


.5260 


.66/9 


.3791 




.66 ■ . 


.6’767 


.5933 


• 6283 


. 3297 


.661 1 




.6009 


.6962 


• 6660 


.3850 


.6623 


• 69<. 


• 6363 


• 519? 


• 5087 


• 6163 


• 3730 


.60 * 


.3120 


• 6082 


.6175 


• 36/6 


• 3163 


• 32‘ 


.5036 


.5023 


.6217 


.3966 


• 6062 


• 3 5 8 1 


.6672 


• 5l65 


.6687 


• 6561 


• 6172 


• 29fi ‘ 


• 6387 


.6726 


.6319 


• 6336 


.6 353 




• 6211 


.6 770 


.6577 


.6253 


• 3653 


.312 


. 3737 


.6312 


.3755 


.36 76 


• 3253 


.357* 


• 368 7 


• 6166 


• 3928 


• 2821 


• 3027 


• 362'J 


• 309 3 


• 3681 


.2995 


.2503 


• 2912 


.306! 


.6755 


.,•6821 


• 3066 


• 6612 


• 3970 


• 282 / 


• 31 1 1 


.3316 


.2980 


.3562 


• 2385 


• 26H'# 


• 6060 


• 5005 


• 6367 


• 3665 


• 3212 


.3356 


• 0509 


• 1651 


• 1665 


.0239 


• 1083 


• 203fi 


• 0251 


• 0731 


• 1182 


• 0615 


.0963 


• 190 7 


• 505 1 


• 6790 


• 6668 


• 3927 


• 6015 


• 36 37. 


.57 30 


.5358 


.6773 


• 6755 


• 6529 


• 2916 


• 5688 


.5767 


• 5173 


• 6937 


• 6677 


.3225 


• 6056 


• 3663 


• 2978 


• 2505 


• 2169 


• 2 326 


• 6630 


• 6680 


• 3816 


.3537 


• 2903 


.3299 


• 3862 


• 3601 


• 3067 


• 2510 


• 1208 


• 2133 


.2560 


.2985 


• 2680 


• 1997 


• 1529 


• 1681 


• >567 


• 5112 


.6637 


• 3907 


• 2301 


• 2866 


• 6627 


• 6270 


• 3690 


• 3601 


• 2652 


• 2762 


• 6613 


• 6133 


• 3717 


• 6025 


• 2061 


.2575 


• 5906 


• 5588 


.6596 


• 6600 


• 3616 


• 3098 


• 5/56 


.6207 


.5511 


• 5656 


• 6627 


• 6l7i8 


• 5186 


• 5196 


• 6965 


• 6666 


• 6393 


• 6 1 5 5 


• 5 >U5 


• 5515 


• 6787 


• 3906 


.6776 


• 6258 


'•3228 


.3073 


• 2776 


• 2112 


• 2552 


• 2515 


• 6696 


• 6619 


• 6111 


• 3762 


• 3930 


.3722 


• 6781 


• 6766 


.3929 


• 6289 


• 3208 


• 2930 


• 6316 


.5928 


• 6765 


• 6659 


• 2967 


• 38 1 7 


• 8069 


• 6218 


• 6716 


• 3966 


• 3115 


• 6253 


• 6327 


.6766 


• 2919 


• 2311 


• 2520 


• 3066 


• 3561 


• 3136 


• 2131 


• 2729 


• 1307 


.2603 


• 2502 


.2796 


• 1689 


• 2367 


• 1968 


• 203 7 


• 2631 


• 2606 


• 1660 


• 13/6 


• 1676 


• 2068 


• 2656 


• 2782 


.2377 


• 1990 


• 2612 


• 252 3 


• 6087 


• 6662 


• 5830 


• 6960 


• 6703 


• 666 3 


• 5693 


• 5691 


• 6805 


• 6183 


• 3861 


.3735 


• 5261 


• 5567 


• 6570 


• 396 7 


• 3894 


• 38 1C 


• 6208 


• 6682 


• 5726 


• 6636 


• 6131 


•6369 


• 6860 


.5929 


• 6720 


• 3760 


• 3665 


• 3512 


• 5569 


• 7163 


• 5380 


• 3876 


• 6009 


•6628 


.6579 


.5665 


• 6156 


• 3899 


• 3581 


• 3813 


• 60C0 


• 6623 


• 3893 


• 5186 


• 3121 


• 3003 


• 3880 


• 6311 


• 3618 


• 2733 


.6737 


• 3210 


• 3355 


• 6?H 


• 3125 


• 2283 


• 2697 


•6686 


• 3669 


• 6160 


.3961 


• 3065 


A 3396 


• 3752 


• 6296 


.51/9 


• 5168 


• 3926 


• 3828 


.3897 


• 3996 


• 6238 


• 6137 


• 3916 


• 3049 


. 327*9 


• 6652 


• 6605 


• 3531 


• 3338 


• 3366 


•28 7! 


• 5095 


• 5321 


.6969 


.6379 


• 3898 


.359C 


• 3761 


• 6119 


• 3520 


• 3369 


• 3205 


• 293o 


• 6621 


• 5100 


.6770 


• 6062 


• 3664 


.335:* 


• 3367 


• 3690 


• 3565 


• 3132 


• 2723 


• 3229 


• 2962 


• 3078 


• 2606 


• 1960 


• 2163 


• 2213 


• 2817 


• 2696 


• 2166 


• 1756 


• 1850 


• 2011 


• 6856 


• 6913 


• 6081 


.3755 


• 3363 


• 3359 


• 3382 


• 356H 


• 3180 


• 3860 


• 2507 


• 2306 


• 6227 


• 6576 


• 6199 


• 3568 


• 3078 


• 3031 


• 0660 


.0992 


• 0857 


• 0683 


• 0869 


• 0960 


• 0621 


. .0616 


• 0956 


• 0637 


• 0606 


.0599 


• 6638 


.67/9 


• 6180 


.3970 


• 3566 


• 3229 


.6799 


.6700 


• 3969 


• 3805 


• 3686 


.3095 


• 566 7 


.5775 


.5126 


• 6785 


• 3877 


• 3872 


• 6106 


• 6055 


• 3366 


• 2951 


• 2336 


• 266«» 


• 6599 


• 6501 


• 6136 


• 3703 


• 2910 


.2826 


.6297 


• 6062 


• 3153 


• 2962 


• 1982 


• 2660 


• 3096 


• 3167 


• 2667 


• 2766 


• 1896 


.2029 


• 5658 


• 5663 


• 6695 


• 6 389 


• 3288 


.3526 


• 6131 


• 6162 


• 3352 


• 3517 


• 2606 


• 2851 


• 3621 


• 3822 


.3206 


.3513 


• 2370 


.2396 


.5967 


• 5276 


• 6332 


• 6061 


• 3296 


• 3262 


• 6166 


.6536 


• 5931 


.5379 


• 6508 


.61^') 


•6756 . 


• 6937 


• 6622 


• 3916 


• 3713 


• 36/2 


.67/5 


• >131 


• 6266 


• 1870 


• 6261 


• 3896 


• 35 31 


• 3262 


• 2565 


• 3183 


• 2691 


.2395 


• 6076 


• 6073 


• 3306 


• 3327 


• 3008 


.29/2 


• 6962 . 


• 6862 


.6052 


• 6116 


• 3355 


• 3169 


• oOOH 


• 5962 


. .6665 


.6557 


.3736 


• 38 1 1 


• 6 760 


• 5963 


• 6686 


• 6203 


• 3789 


.396*7 


.1577 


• 1291 


• 1067 


• 1166 


• 0796 


• 0999 


• 3321 


• 2966 


• 26 30 


• 2621 


• 1763 


• 1986 


.1823 


.1732 


• 1166 


• 1763 


• 1306 


• 1 356 


. 1971 


• 1626 


• 1231 


• 1367 


• 1086 


• 0886 


• 2268 


• 2002 


• 1708 


• 1968 


• 1694 


• 1362 


• 6217 


.36/5 


.2962 


• 3119 


•2668 ' 


• 2111 



U 




.5053 


.•*7d ) 5 


.3969 


a.»u66 < 


*6159 


•66b^ ; 


.3965 


• 'J 2 6 6 ; 


• 6009 


.6163 


.6962 




.6660 


• >08 7 : 


.3850 


• a63 ; 


.6623 


.iliO » 


.6962 


.*(.m 


• 5600 




.6557 




.3933 


.6156 : 


.6675 


.6528 ■ 


.6392 


.66 70 


.6255 


.6820 ' 


.6511 


•6361 ' 


.3175 


. 3086 1 


.2796 


.2593 ' 


.6025 


• 6<»69 


.3080 


• 3068 


.3576 


• 3898 ^ 


.2696 


.2370 ? 


.2206 


• C060 1 


.3935 


.3961 1 


.3978 


.6191 ^ 


.6397 


• >!56 ! 


.1968 


• 2o22 { 


.2m 


.2032 i 


.1693 


.2976 5 


.1827 


• 3105 ; 


.2971 


.6339 ? 


.2650 


• 6126 ^ 


.2863 


• 3969 t 


.3625 


.6268 


.6563 


.5505 ; 


.6597 


• 6600 i 


.6607 


.3925 f 


.2386 


• 2569 1 


.6167 


• 3560 ; 


.3639 


.3772 j 


.38S6 


.6995 1 


.3230 


.3806 [ 


.1937 


•2139 ; 


.2566 


• 321H t 


.1862 


• 1686 1 


.1326 


• 1366 ! 


.2852 


• 2162 « 


.6630 


• i 


.3326 


• 3831 1 


.3786 


• 3983 1 


.3897 


• 6778 1 


.3366 


•3789 ! 


.3726 


• 6137 


.6029 


• 6689 


.3323 


.3957 


.2812 


• 2676 


.2988 


• 2820 


.5768 


• 6651 


.5185 


• 6954 


.6263 


• 6368 


.3488 


• 3929 


.3973 


• 6306 


.3100 


•3326 i 


.3636 


• 6096 i 


.3587 


• 3369 


.2039 


• 2561 


.2019 


•1969^ 


.3387 


•3883 ' 


.2810 


• 2898 


.3165 


• 6031 1 


.1628 


.1377 ; 


.0776 


• 0656 ; 


.3698 


.3796 i 


.3199 


. 3796 i 


.6169 


,6680 i 


.2396 


.2728 


.2978 


• 3590 


.2069 


.305? 


.2296 


• 3108 


.3396 


• 6396 


.2906 


,3561 


.2369 


• 2852 


.2868 


.3726 


.6669 


,5 326 


.6291 


• 6056 


.6315 


• 3819 


.2876 


• 3C02 


.3151 


.2907 


.3366 


.3569 


.3990 


.6652 


.3602 


.3962 


.0858 


.0639 


.1751 


• 2625 


.1667 


.1697 


.0636 


• 1627 


*1582 


.1638 


.1956 


.2095 



I-ll 



TABLE 1-2 (eontlnuad) 



1) 


14 


15 


16 


17 


18 


19 


20 


21 


22 


2 3 


24 


25 


V.rl.bl. 


• 4*H1 


• 5496 


• 0731 


• 5877 


• 5803 


• 4582 


• 4255 


• 4408 


• 6182 


.4492 


.>314 


• liVl 


. 'J JtiC 


1. K-102 63 




• 51 i? 


• 6269 


• 5649 


.5370 


• 3946 


• 4274 


• 4380 


• 5590 


.4286 




• / 




2. R-103 63 


• 406!i 


• >176 


• 5706 


• 5294 


• 5228 


• 4169 


• 4193 


• 41 79 


• 5674 


.4053 






• 0 7'il 


3. X-lOA 63 




• 52 V? 


.5762 


.5710 


.5225 


. 3 77? 


• 4158 


• 4682 


• 6237 


.4195 




• 1 iMH 


• <>>6 7 


A. R-IOS 63 




• 5U34 


.4672 


• 4367 


• 4211 


. W *? 


• 1487 


• 3093 


.4755 


.3111 


.404H 


• 0>C ♦ 


• 92’.1 


S. R-106 63 


•v^Ob^ 


• 50?3 


• 5 1 6 5 


• 4 726 


.4775 


• 4312 


• 4166 


• 3681 


• 4821 


.3316 




• 


.tW 11 


6. X-107 63 




• 4217 


• 4887 


• 4 U9 


.45*77 


• 3755 


. N28 


• 2995 


• 3864 


.2980 


.436/ 


• U;6> 


• U>2 


7. R-10« 63 


• 36?6 


• 1964 


• 4561 


• 4334 


.4253 


• 36 74 


• 2821 


• 2503 


• 4412 


.3542 


. 364*5 


.*)? 1 ♦ 


• On L 5 


•. R-109 63 


• 3U3 


• <»06? 


• 4172 


.4353 


.3053 


.3253 


• 102 7 


• 2912 


• 3970 


.2385 


. 1212 


• i 5 


>63 


9. R-110 63 


• 326? 


• 3!i22 


.2961 


• 152? 


• 3128 


• 3572 


• 3429 


• 3061 


• 2827 


.2489 


• i 1 > 4 




. 1 >0 7 


10. R-111 63 


• 4S*>7 


• 19 33 


.4475 


.4 392 


.4255 


• 4511 


. 31 75 


• 2796 


• 4025 


.3080 


. 




.220M 


11. R-112 63 


• 4679 


.4156 


.4528 


.4479 


• 4M2C) 


• 4361 


• 3084 


• 2593 


• 4669 


,3046 




.2 37C 


.0969 


12, R-113 63 




• J62H 


• 4217 


.37 75 


• 4456 


.4129 


• 2721 


• 2490 


• 4684 


.2989 


• 3137 




.0708 


13. R-llA 63 


• 3628 




• 4 396 


.4748 


• 4122 


• 3069 


.3526 


• 3540 


• 4624 


.3573 


.10 7C 


.Od?C 


• 06‘1H 


lA. 1-115 63 


• 4217 


• 4 396 


• 


• 5117 


• 5080 


. 3769 


.4515 


.3981 


.4790 


.4296 


• 4>iR 


.0505 


• K)6 3 


IS. 1-131 63 


• 377S 


• 4148 


• 5117 




.4263 


• 3479 


.3595 


. 3990 


• 4874 


.3668 


• >>23 


.0^*59 


.094 7 


16. 1-132 63 


• 4456 


• 412? 


• 5088 


.4263 




. iUS 


• 326 f 


.3341 


• 4195 


.3940 


• 4262 


• QHOc 


.0759 


17. 1-133 63 


• 4129 


• 3069 


• 3769 


• 3479 


.3320 




• 2427 


.2472 


• 3183 


.3029 


• U5H 


• 1536 


.1249 


18. 1-13A 63 


• 2721 


• 3526 


• 4515 


.3595 


• 3203 


• 2427 




• 2965 


.3130 


.2574 




• Oni? 


• 1024 


19. 1-135 63 


• 2490 


• 3540 


• 3381 


.3990 


.3341 


.24 72 


• 2965 




• 3194 


.2588 


• 3276 


• OHHO 


• 0896 


20. 1-131 63 


• 4684 


• 4624 


.4 790 


• 4874 


• 4195 


• 3183 


• 3130 


.3194 




.3764 


.3:527 


.0620 


.0 752 


21. 1-139 63 


• 2989 


• 3573 


• 4296 


• 3668 


• 3940 


.3029 


• 2574 


.2588 


.3764 




• 3082. 


• 04X; 


• 0510 


22. 1-lAO 63 


• 3137 


.3070 


• 4518 


• 4423 


.4262 


.3156 


• 3385 


.3276 


.3527 


.3082 




• 10^2 


.0719 


23. 1-1A2 63 


• 2009 


• 0820 


.0505 


• 0859 


• 0806 


.1536 


• 0632 


.0880 


• 0620 


.0440 


• 1092 




.0969 


2A. 1-1A5 6;3 


• 0708 


• 0688 


• 1069 


.0947 


.0759 


.1249 


. 1024 


• 0896 


.0752 


.0510 


.0719 


.0969 




25. R-1A6 63 


• 4043 


• 4504 


• 4689 


.4077 


• 3916 


• 3555 


• 3113 


.2898 


.38 76 


.3482 


• 3292 


• 0d09 


.1106 


26. 1-1A7 63 


• 4005 


• 5232 


• 6292 


.5198 


.4916 


• 3656 


• 4040 


.3876 


.5170 


.4134 


• 40B9 


.0539 


;076l 


27. 1-150 63 


•4902 


• 4709 


• 5951 


.5456 


.5511 


.3527 


.3638 


.3678 


.6165 


.3693 


• 432H 


• 0691 


• 0680 


21. 1-162 63 


• 1737 


• 31H0 


• 4240 


.4143 


.3422 


.2046 


.3390 


• 3427 


.3138 


.2661 


• 4266 


• 071C 


• OH IB 


29. 1-212 63 


• 1829 


• 3/52 


• 4341 


• 2859 


• 3197 


• 1325 


.2682 


.2189 


• 3268 


.2136 


• 2H26 


• 026 7 


• 0023 


30. 1-220 63 


• 1861 


• 3040 


• 3856 


.3580 


.3366 


.2014 


.3142 


.2858 


• 3062 


.2645 


• 2990 


• 0414 


.1113 


31. 1-231 63 


• 2036 


• 23/4 


• 2348 


.2599 


.3006 


• 1316 


.1787 


.2154 


.2068 


.2060 


• 2136 


• 0394 


-.0168 


32. 1-232 63 


• 2864 


• 4210 


• 3978 


.4226 


• 3816 


.2296 


• 3315 


.3302 


• 4198 


.3042 


• 3609 


.0187 


• 0886 


33. 1-233 63 


• 2573 


• 34 18 


• 3776 


.3515 


• 4174 


.2101 


• 30H0 


.2972 


• 3064 


.2355 


• 3788 


-•C2x: 


.0044 


3A. 1-23A 63 


• 3300 


• 3345 


• 3 706 


.3247 


• 2879 


• 1996 


• 2633 


.2871 


.3354 


.2164 


• 3263 


• 0301 


• 0146 


35. 1-23S 63 


• 3027 


• 3958 


• 4215 


.4730 


.4105 


.2628 


• 3452 


.3173 


.4319 


.3416 


• 4?62 


.0327 


-.0137 


36. 1-2A0 63 


• 4233 


• 4270 


• 6543 


.5912 


.5330 


.3 704 


• 4480 


.3865 


.9509 


.4321 


.5^r67 


.0870 


' .0594 


37. 1-2S0 63 


• 3476 


• 4326 


• 4399 


• 3929 


.3337 


.2331 


.2873 


.3343 


• 4043 


4 2642 


• 3331 


• 06lG 


.1261 


31. 1-260 63 


• 3153 


• 3374 


.3534 


• 3028 


.2357 


.2328 


.1935 


.3045 


.3241 


.2079 


• 2554 


• 0 76 H 


.0557 


39. 1-270 63 


• 1856 


• 2341 


• 1891 


.1166 


.1729 


.2044 


.0984 


.1420 


.196 7 


.1146 


.1/03 


• 3196 


• 0721 


AO. 1-201 63 


1 •3527 


• 2737 


• 2881 


• 2642 


• 2893 


.2478 


• 2298 


.2266 


.2822 


.2084 


. 3233 


• 0316 


• 0487 


Al. 1-212 63 


1 •3599 


• 3795 


• 4394 


• 4011 


• 3713 


.2957 


.2916 


.2535 


.4197 


.3209 


• 3400 


• 0599 


• 0868 


A2. 1-290 63 


|•3925 


• 4502 


• 4493 


• 4788 


.3925 


.2952 


. 3550 


.3176 


.5241 


.2827 


.4259 


• 0408 


• 0/52 


A3. 1-3U 63 


|•30B7 


• 4135 


• 4323 


• 4293 


• 3956 


.2493 


.3820 


.3711 


.4216 


.2924 


• 3910 


• 0287 


• 0723 


44. l-3li 63 


L1415 


• 3064 


• 3925 


• 3645 


• 3081 


.2470 


.3766 


.3331 


• 2941 


•2279 


^3104 


• COOH 


• 0929 


45. 1-333 63 


|«2394 


• 2829 


• 2685 


• 2711 


• 2545 


• 1240 


.1864 


.2187 


.3343 


.2826 


• 2761 


• 0550 


.0700 


46. ff^io 63 


|•0803 


• 2141 


• 2249 


• 123^ 


• 3193 


.1083 


• 1165 


.0958 


.1960 


.2159 


• 1768 


• 0314 


.0491 


47. f-420 63 


l^ou? 


• 1703 


• 0790 


• 1315 


.1569 


• 0864 


.1033 


• lllO 


*1541 


.0789 


.0393 


• 0685 


• 0913 


46. r-430 63 


UiifO 


• 2060 


.1713 


• C8B1 


• 2238 


• 2028 


.0870 


• 1072 


.1308 


.1703 


• C650 


• 0114 


• 0117 


46. f-4M 63 


|»4153 


• 5143 


• 5896 


• 5268 


• 5048 


• 3557 


• 4698 


.4317 


.5206 


.3634 


.4780 


.0700 


• 0748 


So. i-ioi it 


U3247 


• 4292 


• 5745 


• 4484 


.4318 


• 2616 


• 4435 


.3750 


•4314 


.3116* 


.4516 


• 058H 


.0572 


SX. 1-103 60 


L3824 


• 4993 


• 5439 


.4571 . 


• 4252 


• 3076 


• 4177 


«4089 


•4652 


• 3294 


.3912 


• 0186 


• 0549 


32. 1-106-60 


• 3874 


• 5236 


• 5873 


• 5513 


• 4803 


• 3408 


.4513 


.4401 


• 5027 


.3552 


<t5024 


• 0962 


.0435 


S3. 1-lDS 60 


• 3275 


• 4149 


• 4376 


• 4357 


• 3812 


.3147 


• 3908 


.3550 


.4251 


• 2859 


o36H9 


.0336 


• 0731 


34. 1-106 60 


{•3311 


• 4280 


• 4806 


• 4330 


.4255 


.3 394 


• 3797« 


• 3227 


.4211 


.2763 


c>3949 


.1025 


.0607 


SS. 1-107 iO 


L3970 


• 3710 


• 4401 


• 4118 


• 4067 


• 2997 


• 3297 


• 2948 


.3528 


.2646 


• 3787 


.1072 


• 1137 


36. 1-106 60 


• 3371 


• 3220 


•4111 


• 3970 


• 372fi 


.2898 


• 2766 


.2912 


. 3738 


4 3128 


4 3669 


• 0813 


• 0423 


57. 1-106 «0 


• 2227 


• 3007 


• 3229 


• 3108 


.2874 


.2104 


• 2554 


• 2729 


.2730 


.2016 


.2682 


.0603 


• 0993 


St. 1-110 60 


• 2321 


• 2410 


.2596 


• 2466 


• 2232 


.2033 


• 2592 


.1951 


.2425 


.1569 


.2261 


.0761 


.0936 


39. R-U3 63 


• 3738 


• 3126 


• 3527 


• 3564 


.2935 


• 2970 


.2557 


.2643 


.3276 


.2174 


.2596 


• 1582 


• 1644 


60 . 1-112 00 


• 4S27 


• 3846 


• 4517 


• 4546 


• 4178 


• 3930 


• 3180 


• 2763 


.4284 


.2765 


.3776 


• 171H 


.1044 


62. t-llS iS 


• 4477 


• 3913 


• 3913 


• 3901 


• 3656 


• 3404 


• 3094 


.2489 


.3782 


.2956 


.2782 


.1002 


.0753 


62. 1-114 <3 


«3249 


• 6054 


•4213 


.4116 


.3653 


.2518 


.3266 


«3211 


• 378f 


4 3128 


.2722 


.0374 


• 0899 


63. 1-US tOi 


• 3540 


• 4439 


• 6646 


.44 70 


• 4567 


.3312 


44056 


.3552 


.4409 


.3618 


• 3874 


.0343 


.0635 


64. 1-131 63 


• 2753 


• 3529 


• <3063 


• 4483 


.3376 


.2379 


.2864 


«286l 


.3790 


.2636 


.3350 


.0351 


• 023H 


6s. 1-132 63 


• 3749 


• 4008 


• 4830 


• 4082 


• 5414 


.3470 


.3*18 


.3078 


.4266 


.3074 


.3624 


.0425 


.0472 


66. 1-133 63 


• 3151 


• 2981 


• 3396 


• 3197 


.3143 


.4121 


.2708 


.2077 


.3270 


.2502 


.2431 


.0629 


• 0966 


67. i<^lS4 ,63 


• 2331 


• 2698 


• 3172 


.2693 


.2527 


.17*5 


.3555 


• 2313 


.2696 


.2110 


.2527 


.0394 


.0433 


66. 1-133 13 


• 1579 


• 2448 


• 2666 


• 2865 


.2224 


.1646 


.2012 


• 3379 


.2929 


.2098 


.2496 


.0423 


.0443 


66. i-iSii (13 


• 3232 


• 3670 


• 4350 


• 3888 


.3316 


.2270 


.3275 


.3090 


.9166 


.2847 


.3345 


.0303 


.0270 


70. 1-136 13? 


• 2830 


• 3151 


• 4116 


.3243 


• 2909 


.2495 


.2548 


• 2462 


.3969 


.4232 


.2638 


.0071 


•.0092 


71.1^143 63 


• 319C 


• 2928 


.4243 


.3681 


.3858 


.2563 


.321* 


.3041 


• 3287 


.2929 


• 7606 


.0717 


.0241 


72 . |(-14 63 


• 0822 


• 052B 


• 0732 


• 0601 


•0672 


.1172 


.0216 


.0986 


.0638 


•0315 


.0580 


.2387 


.0720 


73. 1-243,63 


•0557 . 


• 0974 


• 0702 


.0438 


.0471 


• 0364 


• 0193 


•0246 


.0979 


.0457 


•0l9t . 


.0521 


.2353 


74. 1-146 63 


• 3899 


• 4118 


• 4408 


• 3858 


• 3725 


.3098 


.3407 


• 2621 


• 3781 


.3325 


.2981 


• 0004 


. 1009 


u. Htfii 


• 3134 


• 4446 


• 5367 


• 4221 


.3903 


• 2997 


.3878 


.3316 


.4467 


4 3205 


.3145 


.0103 


.0487 


‘ #6. ■•xSv ■ 


•4052 


• 4334 


• 5771 


• 4710 


.4 769 


. 3330 


.3923 


• 3971 


• 4971 


.3713 


.4321 


.0052 


.0459 


77. 1-162 63 ' 


• 2165 


• 3135 


.3353 


.2886 


.3061 


.1945 


• 2*85 


.2311 


.2847 


.2121 


.2818 


.0297 


-.0024 


.73. 0-212 M 


• 2421 


• 3834 


• 4433 


• 3714 


• 3991 


.2 764 


.3279 


• 2972 


• 3770 


.3123 


.3274 


• 035i 


.0566 


76. 1—220 6(3 


• 2010 


• 3067 


• 3464 


• 3086 


.3300 


.2075 


.2937 


.2965 


.3298 


4 2232 


.2744 


.0460 


.0315 


•0. 1-231 63 


{•2391 


• 2761 


• 3796 


• 3490 


.3533 


• 2 354 


.2567 


• 2341 


• 3674 


.2692 


.2874, 


• 0075 


.0352 


61. 1-232 60 


L3221 


• 3955 


.4557 


.4563 


.4259 


.2925 


• 3650 


• 3268 


• 4472 


.3246 


• 4073 


.0625 


.0432 


62. 1-233 to 


12621 


• 3062 


.4197 


.3705 


.3631 


.2415 


• 3044 


• 2805 


.3939 


.2623 


.3117 


• 0324 


.0526 


•3. 1-234 to 


i 

W2724 


• 2706 


• 3612 


.3407 


.3184 


.2111 


.2564 


• 2229 


• 3316 


.2472 


.3123 


• 0218 


.0407 


64. 1-235 40 


!b2605 


.3772 


• 4326 


• 4076 


.3739 


.2608 


.3972 


.3011 


• 4028 


.2953 


.3987, 


.0212 


.0270 


OS. 1-240 40 


Ul60 


• 4987 


• 6151 


.5570 


.5204 


.3714 


• 4414 


.3970 


• 50H3 


.3729 


.5457 


.0561 


.0670 


M. 1-250 to : 


• 3502 


• 3666 


• 4433 


• 3876 


.3516 


• 2949 


• 3i78 


• 2388 


• 3998 


• 2626 


.3406 


• 0514 


.0799 


07. 1-260 60 


13361 


.3577 


.3907 


• 3350 


.3070 


• 2889 


• 2621 


.2698 


• 3257 


^2449 


• 2967 


.0795 


.1001 


66. 1-270 60 


• 2554 


.2702 


• 2821 


• 2133 


.2277 


.2201 


.1352 


.1569 


.2924 


• 2106 


.1834 


• 0136 


.0/25 


16. 1-261 60 


.2900 


.2704 


.2974 


.2833 


• 2586 


• 2355 


• 2143 


.1701 


.2798 


.2085 


• 2504 


• 0248 


.0520 


60 . 1-262 to 


b3213 


• 3421 


• 4079 


.3685 


.3571 


• 2667 


.2987 


• 2645 


• 3617 


4 2688 


.3277 


• 0425 


• 0638 


61. 1-260 60 


h\5l8 


• 3886 


• 4077 


• 4594 


.3790 


.2977 


• 3292 


• 3268 


• 4884 


4 3027 


• 3947 


• 0620 


• 0301 


62. 1-311 to 


1 3245 


• 4 309 


• 4449 


.428? 


• 3993 


• 2928 


• 3393 


• 3096 


• 4362 


.3088 


.:3*f95 


• 0182 


.0407 


63. 1-312 60 


&0548 


• 1074 


• 0819 


• 05 36 


.0747 


.0793 


• 0677 


• 0372 


• 0790 


.0946 


• 0548 


• 0326 


• 0449 


64. 1-333 60 


f.14^71 


.2787 


• 257? 


.2566 


• 3016 


• 1695 


• 1967 


• 1661 


• 3327 


•2581 ' 


.198*7 


• 0299 


• 0116 


65. r-410 60 


U431 


.1780 


• 1675 


.1538 


• 2178 


• 1336 


• 0857 


• 1110 


• 1646 


.1760 


• 1336 


• 0393 


• 0065 


H. r-420 60 


f.0692 


• 1444 


• 1486 


• U45 


• 1201 


• 0844 


• 1492 


• 0963 


• 1071 


• 1392 


.0744 


• 0205 


• 0231 


67. r-430 60 


1 158.0 


.1827 


• 1616 


• 1202 


• 1682 


• loot 


• 0854 


• 0834 


• 1066 


.1300 


• 0662 


• 0268 


• 0201 


60. r-440 60 


Il950 


.3533 


• 3885 


• 3000 


• 2557 


• 2044 


• 3006 


• 2603 


• 2783 


• 2462 


• 1590 


-.049? 


, -.0099 


66. P*I01 60 



ERIC 
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TABLE 1-2 (continued) 





Verleble 


2b 


27 


2H 


29 




T. R-102 63 Voceb. I 


• 55<C 


• 0967 


./1/9 


• 41 96 




2. R-103 63 Llteretura 


.51^5 


• 6446 


.6513 


.-9927 




3. R-106 63 Mualc 


• 4H01 


.6377 


• 6l58 


• 3661 




4. R*105 63 Soc. Stud. 


.5064 


• 6136 


.6592 


.9991 




5. R-106 63 Math 


• 5C5I 


.5730 


.568H 


• 4054 




6. R-107 63 Fhys. Scl. 


.4790 


• 535B 


.5747 


• 3463 




7. R-108 63 Bio. Scl. 


.4468 


.4773 


.5173 


.2978 




8. R-109 63 Sclent. Att 


.3927 


.4755 


.499/ 


.2505 




9. R-110 63 Aero-Space 


• 4015 


.4529 


.447/ 


• 2189 




10. R-111 63 Electronic 


• 3436 


• 2914 


.3225 


.2324 




11. R-112 63 Mechanlca 


.39 15 


.3978 


.439/ 


• 1948 


12. R-113 63 Farming 


• 3961 


.4191 


• 5156 
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• 3476 


• 3153 


• 1056 


• 3527 


• 3599 


.3925 


.3067 


• L4I5 


• 2194 


.0801 


.<114.7 


.11 70 


• 415) 


X3* R-XX4 63 


• 4316 


• 3374 


• 2341 


.27)7 


• 3795 


• 450a 


.4135 


• 1064 


.2627 


• 2141 


.1703 


.2069 


• 5143 


X4* R— XX5 63 


• 4399 


• 3534 


• 1091 


• 2101 


.4394 


•4493 


.4323 


• )925 


• 266 5 


• 2249 


• 0700 


a 1 7 1 3 


• 5896 


X5, R-X3X 63 


• 3929 


• 3020 


• 1166 


• 2667 


• 4011 


.4700 


.4293 


• )645 


• 2M1 


.1217 


. 1 t 1 >3 


• 0801 


• 5260 


X6* R— X32 63 


• 3337 


• 2357 


• 1729 


.2193 


.3713 


• 3925 


.3956 


.3081 


• 2545 


• 3191 


• I960 


.2230 


• 5040 


X7. R-X33 63 


• 2331 


• 2320 


• 2044 


• 2678 


.2957 


• 2952 


.2493 


.2470 


• 1240 


• 108 i 


.0H<y4. 


.2028 


• 3557 


XO. R-X34 63 


• 2073 


• 1935 


• 0904 


• 2290 


.2916 


.3350 


.3020 


• 1 766 


• 1 064 


• 1163 


• lO'H 


• 08 70 


• 4690 


X9. R-X3S 63 


• 3343 


• 3045 


• 1420 


.2266 


• 2535 


.3176 


.3711 


. mi 


• 2107 


• 09!»0 


• me 


• 1072 


• 4317 


20. R-X30 63 


•4043 


• 3241 


• 1967 


.2822 


• 4197 


.5241 


.4216 


.2941 


• 3143 


• 1960 




• 1 100 


• 5206 


2X. R-X3f 63 


• 2642 


• 2079 


• 1146 


• 2004 


•J2U9 


.2027 


.2924 


• 22^9 


• 2026 


.2157 


.07H<) 


• 1703 


• 1634 


22. R-X40 63 


. ^331 


• 2554 


• 1703 


• 3233 


.3400 


•4259 


• 3910 


• )I04 


• 27ol 


• I7<i8 


.01 »3 


• 0650 


• 4700 


23. R-X42 63 


• 0610 


• 0760 


• 0196 


.0316 


• 0599 


.0400 


.0207 


• 0000 


• 0‘i50 


• 0314 


.ObH-i 


• 0114 


• 0700 


24. R-X45 63 


• 1261 


• 0557 


• 0721 


.0487 


.0068 


.0752 


.0723 


.0929 


• 0700 


• 0491 


.0013 


.0317 


• 0 74 0 


25. R-X46 63 

26. R-X47 63 

27. R-XSO 63 


• 2974 


• 3069 


• 2415 


.3170 


.4016 


.3706 


,4303 


. 1845 


.2202 


.1170 


.1061 


. 1386 


• 4689 


• 3407 


• 2062 


• 1221 


.1697 


.4054 


• 4554 


.4155 


.3633 


• 2uOl 


• 2234 


.11116 


• 1 4 86 


'.5742 


•4396 


• 3146 


• 1790 


• 2952 


• 6541 


,5031 


.4320 


• 3141 


• 2300 
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. 1 766 


• 1294 


• 5870 
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29. R-2X2 63 

30. R-220 63 


• 3746 


• 3337 


• 1849 


• 3212 


.4041 


• 4439 


.4205 


• 3172 


.3401 


.2601 


. I',36 


. .2443 


• 4358 


• 4646 


• 3697 


• 3045 


• 3111 


.3606 
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.4240 


• 3316 


.3310 


..3090 
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.2260 
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• 2600 
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.4707 


.5229 
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.2410 
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• 2474 
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•4927 
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.4761 


.4062 


.2373 
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• 1043 


• 4550 
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•4627 


• 4594 


• 3776 
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• 2404 
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.2369 


• 2535 


*2522 


• 3342 


• 2625 
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• 5716 
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• 2961 
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• 2456 
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• 2166 
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• 2373 
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• 3191 


•4069 


.4160 
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.2920 


• 3109 
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•2410 
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• 2535 
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• 2252 
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.3705 
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• 3342 
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.1392 
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• 4550 
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• 3022 


•4311 
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• 4696 
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• 2044 


• 1796 
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• 3742 
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• 3149 


• 3017 
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• 1721 
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.1641 
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• 2065 


• 6215 


52. R-104 60 


•4700 


•4066 


• 2204 


• 3620 


* .4499 


• 5747 


.5770 


.4415 


.3090 


.1757 


.2220 


• 1501 


• 6006 
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•4460 


•6100 
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• 3730 
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• 5543 
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• 2056 
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• 1055 


• 5021 
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• 2690 
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•4135 


• 3490 


• 2394 


.3579 


• 3632 


•4391 


.3101 


.2041 


.2037 


• 1404 


.1175 


• 1651 


•4903 


62. R-X14 60 


• 3454 


• 2952 


• 2075 


• 2459 


• 3241 


•4040 


.4072 


• 316? 


.2666 


.1977 


.2000 


.2110 


• 4073 
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• 5640 
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• 3069 


.2902 
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67. R-X34 60 
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• 2372 
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• 2307 


• 2134 


• 2796 


•2427 
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• 1C70 


• 1469 


.1545 


.1922 


69. R-X35 60 
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• 1700 


• 0971 


• 1291 


• 1716 


• 2151 


.2309 


.1056 


.1159 


• 0662 


•0573 


• 0633 


• 3160 


69. R-X30 60 


•4011 


• 3003 


• 1924 


• 2706 


• 3175 


•4207 


• 3765 


• 2921 


.2310 


• ueo 


• 1040 


• 1309 


• 5206 


70. R-X39 60 


1 *3453 


• 2132 


• 2001 


• 2632 


• 3111 


• 3131 


• 3000 


• 2006 


.2460 


• 2160 


.1755 


• 1C120 


• 4166 


71. R-X40 60 


1 ^3700 


• 2766 


• 1695 


• 2913 


• 3132 


. •4230 


.4217 


• 2999 


.2437 


.0979 


.0762 


• 0093 


•4051 


72. R-X42 60 


f • •0505 


• 0373 


-•0119 


.0417 


• 0505 


• 0701 


,0416 


-.0213 


.0747 


• 0334 


• 017/ 


.0346 


•0025 


73. R-X45 60 


1 ^0720 


• 0331 


• 0325 


• 0163 


• 0221 


• 0210 


,0160 


•0154 


.0139 


-•0100 


-*0035^ 


• 0065 


.0533 


74. R-X46 60 


! •3039 


• 3401 


• 2372 


• 3249 


• 3660 


•4303 


• 4057 


• 3229 


.2694 


• 2166 


• 1713 


.203? 


.5059 


11: m 18 


J •4226 


• 3199 


• 1035 


• 2696 


• 3469 


•4149 


.3901 


• )060 


.2374 


• 1606 


• 1042 


.1738 


• 5920 


$ *4744 


• 3556 


• 2203 


• 3321 


•6015 


• 5004 


• 4543 


• 3474 


.2703 


• 1604 


• 1802 


• 1734 


.6364 


77. R-X62 60 


^ •3631 


• 3157 


• 2071 


• 2944 


• 3260 


•3794 


.3000 


.2914 


.2565 


.1336 


• 1005 


.1405 


.4171 


70. R-2X2 60 


; •4252 


• 3539 


•2642 


• 2991 


• 3121 


•4020 


.3971 


• 2904 


..?8)1 


.2409 


• 2041 


.2352 


• 5364 


79. R-220 60 


i ^•3621 


• 2422 


• 1532 


.2254 


«3036 


.3143 


.4063 


• 2006 


.1203 


.1972 


.2550 


• 1260 


•4629 


10. R-23X 60 


I •2040 


• 2532 


• 1700 


o2090 


• 3560 


• 3640 


.3520 


.2010 


.2922 


• 1 64 7 


• 1511 


.1603 


• 3470 


IX. R-232 60 


• 4499 


•6267 * 


• 2664 


• 3946 


•6026 


• 5134 


.5075 


• 4241 


• 3914 


.1968 


.2197 


• 1967 


• 5567 


•2. R-233 60 


\ •3500 


• 3114 


• 1909 


.2010 


• 3511 


•4195 


.3053 


.2671 


• 2963 


• 1445 


• 1622 


.1718 


■ 466 1 


63. R— 234 60 


! ^3404 


• 3112 


• 1055 


• 2443 


• 3634 


•4059 


.3594 


• 2524 


.2723 


.0995 


.1207 


• 1212 


•4112 


14. R-235 60 


•4605 


• 4070 


• 2520 


.3560 


• 4339 


.5506 


.5751 


.4615 


.3279 


• 1627 


.2401 


.2005 


• 5442 


05. R-240 60 


[ ^5390 


•4450 


• 2762 


• 4030 


• 5051 


•6252 


.5735 


• 4309 


• 3541 


• 2065 


• 2446 


• 2008 


• 7141 


16. R-250 60 


• 5373 


• 3121 


• 2650 


.3606 


•4069 


• 4723 


.4190 


.3433 


2400 


.1343 


.1737 


• 1760 


.5195 


17. R-260 60 


•4219 


•6399 


• 3026 


.4916 


•4600 


• 4043 


.4412 


• 3640 


• 2231 


• 1759 


• I6H0 


• 2349 


• 4629 


li. R-270 60 


• 2996 


• 4142 


• 5709 


.4100 


• 4010 


• 3431 


.3175 


• 2242 


.2520 


• 2014 


• 2C33 


.2757 


.304? 


09. R-20X 60 


• 3099 


• 5000 


• 6279 


• 5925 


• 4650 


•4050 


.3944 


• 1200 


• 2104 


• 1622 


• 1634 


• 2403 


• 3401 


90. R-212 60 


1 •4430 


•4774 


• 3646 


• 4723 


• 6006 


• 5233 


.4675 


• 3471 


• 3115 


• 2209 


• 2386 


• 3032 


• 4635 


IX. R-290 60 


f ^4770 


•4595 


• 2936 


• 4413 


.4953 


• 6794 


.5710 


• 4421 


.1537 


• 1046 


• 2145 


• 1924 


• 5641 


92. R-3XX 60 


•4606 


•4600 


• 2052 


•4269 


•4021 


• 6017 


.6742 


• 5244 


• 3663 


.2375 


• 2228 


• 2276 


• 5519 


93. R-3X2 60 


1 •1035 


• 1043 


• 0620 


• 0701 


• 0790 


•0966 


.1279 


• 1518 


• 0650 


• 0405 


• 0441 


• 0305 


.110? 


94. R-333 60 


1 •2936 


• 2406 


• 2196 


• 2571 


• 3396 


• 3670 


.3450 


• 2209 


•4611 


• 2310 


• 2183 


• 2036 


• 3303 


95. F-4X0 60 


1 •1709 


• 1699 


• 1490 


• 1516 


• 2222 


• 1793 


.1679 


.0774 


• 22)9 


• 2406 


• 1697 


• 1997 


• 1?64 


96. P-420 60 


[j •lOOl 


• 1379 


• 1527 


• 1670 


• 1941 


• 2241 


• 2600 


• 1602 


• 2704 


• 2026 


• 2779 


• 1967 


• 2210 


97. P-430 60 


[: • 1004 


• 2206 


• 2200 


• 2693 


• 2696 


• 1074 


.1026 


• 1115 


• 2146 


• 2471 


,2)53 


• 4070 


• 1?94 


90. P-440 60 


|; ^2003 

f 

ERIC 


• 2795 


• 1394 


• 2075 


• 3093 


• 3320 


• 3721 


• 2006 


• 1461 


•'1030 


• 1966 


• 1509 


• 4125 


99. P*iOI 60 
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T. K-102 63 Voctb. I 
2t X-103 63 Utaiatur* 
3, R-104 63 Muale 
6. R'103 63 Soc. Stud. 

5. R-106 63 Hath 
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I 

i 
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7a MOS 63 Bio. Scl. 
ta B-109 63 Scl«ntdAct 
9a B-110 63 A«ro-Spac« 
10a B-IU 63 EXtctrpBle 
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12 a B^U3 63 Fanilns 
13a R-ii4 63 Hom ECa 
14a R-llb 63 Sports 
ISa R-131 63 Art 
16a R-132 63 Uv 
17a R-133 63 Hoalth 
Ita R-134 63 Englna 
19a R-13S 63 Arch a 
20a R-'13l 63 MiliUry 
21a R-139 63 Acct«Buola 
22a R-140 63 PrscaKnovl 
23. R-142 63 Blb|« 

24a R-145 63 Hunting 
25a B-*146 63 Fishing 
26a R-147 63 Outioor 
27a B-150 63 Thsstsr 
2ta B-162 63 Vocsba XX 
M-212 63 Mm. Words 
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41. 
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45. 
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f-420 63 
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60. 
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R-104 60 
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• 2353 


• 1009 


25. R-144 43 


•5491 


•4179 


• 3149 


• 3624 


• 3254 


• 2519 


• 2348 


• 3302 


• 3099 


• 3087 


• 0611 


•0404 


• 5062 


24. R-147 43 


•4340 


• 5315 


• 3774 


• 4610 


• 3099 


• 2H5H 


• 2 764 


.4187 


• 3699 


• 3745 


• 0654 


• 0778 


•4042 


27. R-lSO 43 


•4054 


• 5273 


•4193 


• 5124 


• 3444 


• 2857 


• 2718 


• 4557 


• 409) 


• 3966 


• 0928 


• 08** 


•4320 


21. R-163 63 


• 5197 


• 3403 


• 3014 


.3463 


• 243) 


• 2612 


• 19)0 


.2700 


• 2425 


• 3855 


•0314 


•0358 


• 3354 


29. R-212 63 


•2703 


•4295 


•2452 


.3729 


• 2659 


• 2443 


• 1400 


.3343 


• 2980 


• 3052 


• 0272 


-•0208 


• 3551 


30. R-210 63 


•2747 


• 5714 


• 2544 


• 3965 


• 2SH0 


• 2549 


• 1466 


.3001 


• 2434 


• 2987 


•0231 


• 0377 


• 2995 


31. R-231 63 


• 1922 


•2294 


• 1904 


• 2650 


• 1401 


• 1680 


• 0835 


• 1992 


• 2045 


• 1865 


• 0493 


-.0147 


• 2272 


32. R-232 63 


•5529 


• 4379 


• 3459 


•4374 


•2913 


• 2778 


• 1944 


• 3598 


• 3308 


• 3988 


• 0407 


•0152 


• 3970 


33. R-233 63 


•2950 


• 3944 


• 3014 


•4002 


• 2139 


• 2393 


• 1687 


• 3022 


• 2451 


• 3358 


• 040* 


• 0150 


• 3222 


34. R-234 63 


•5024 


• 3495 


•2595 


.3756 


• 2159 


• 2287 


• 1550 


• 2856 


.2971 


• 304 7 


•0207 


• 0158 


• 345* 


33. R-23S 63 


•5445 


•4410 


• 3000 


.4199 


• 3350 


• 2937 


• 1764 


•4184 


.3321 


• 4094 


• 0225 


•0409 


• 3941 


34. R-249 43 


•4040 


• 5790 


•4309 


• 5214 


• 3948 


• 3231 


• 2562 


• 4845 


• 4297 


.5479 


• 0575 


• 03*3 


•4*30 


37.. R-2S0 43 


•5454 


•4499 


• 3524 


• 3967 


• 3279 


,2835 


• 2010 


•4011 


• 3453 


• 3700 


• 0585 


•0720 


• 39)9 


39. R-260 43 


•2952 


• 3971 


•2524 


.2967 


• 3082 


• 2372 


• 1780 


• 3003 


• 2832 


• 2766 


•0373 


• 0331 


• 3401 


39. R-270 43 


•2075 


•2590 


• 1420 


• 1933 


•2040 


• 1594 


.0971 


.1924 


• 2001 


• 1695 


-•0119 


• 0325 


• 2372 


40. R-2il 43 


•2459 


• 3339 


•2292 


.2645 


• 2660 


.2316 


• 1298 


• 2706 


• 2632 


• 2913 


•0417 


• 01*3 


• 3249 


41. R-242 63 


• 5241 


•4039 


•2942 


• 3640 


•2937 


.2307 


.1716 


• 3175 


• 3191 


• 3132 


•050$ 


• 0229 


• 3**0 


42. R-290 63 


•4040 


•4397 


• 3945 


.4329 


• 3069 


• 2834 


.2151 


.4207 


.3131 


•4238 


• 0709 


• 0210 


• 4393 


43. R-311 43 


•4072 


•4330 


• 3797 


• 3923 


•2902 


.2736 


• 2309 


• 3765 


• 3099 


•4217 


•041* 


• 01*0 


•4057 


44. R-3ia.43 


•5142 


• 3419 


• 3000 


• 2717 


• 2032 


.2427 


• 1H56 


•2921 


• 2096 


• 7999 


-•0213 


• 0154 


• 3229 


45. R-333 43 


•2444 


•2595 


•2057 


.2954 


• 1944 


• 20H4 


• 1159 


• 2310 


• 2460 


♦ 2A37 


• 0747 


• 0139 


• 2*94 


44. r-410 43 


• 1977 


• 1442 


• 1044 


• 1630 


• 12)0 


• 1078 


• 0662 


• 1488 


.2168 


•0979 


• 0334 


-•0100 


• 21*0 


47. r-4M 43 


•2000 


• 1929 


• 1144 


• 1751 


• 1351 


• 1469 


.0573 


• 1848 


.1755 


• 0762 


•0177 


-•0035 


•i7U 


4«. »-4N 43 


•2110 

•4075 


• 1414 
•4204 


•0931 

•4405 


• 1691 

.5649 


• 1504 

• 4167 


• 1,545 

• 3922 


*0633 
• 3160 


• 1309 
.5286 


• 1920 

• 41*6 


•0893 

•4851 


•0344 
• 0925 


• 00*5 

• 0533 


• 2037 
•5059 


50l 


•4514 


•5957 


•4159 


.4734 


• 3363 


' .3930 


.2994 


• 4548 


• 3643 


• 494« 


•0579 


•0*54 


• 4473 


SI. 1-iea 4i 


•4942 


• 5792 


•3994 


•4970 


• 353? 


• 3625 


• 2776 


• 4584 


• 3829 


.4133 


•0544 


• 0*34 


< .4540 


92. R-104 40 


•4492 


• 5924 


•4513 


• 5369 


• 3742 


• 3971 


.3297 


• 514C 


•4210 


• 5130 


•0*79 


•0*23 


•4779 


S3. R-109 60 


•4259 


•4999 


•3411 


.4133 


• 3416 


• 316H 


• 2784 


.4333 


• 3269 


• 3999 


•0493 


•0*02 


•4172 


S4. R-104 40 


•5944 


•4900 


• 3394 


•4664 


• 34)6 


• 3295 


• 2502 


•4220 


• 3114 


• 4060 


•07*1 


•04*1 


•4095 


SS. R-1Q7 40 


•5454 


•4514 


• 3441 


•4553 


• 3375 


• 2996 


• 2231 


• 3745 


• 2903 


• 4150 


• 0904 


•0705 


43931 


S4. R-104 40 


• 5073 


•4204 


•3111 


• 3997 


• 2771 


• 2379 


• 1910 


• 3651 


• 3243 


• 3*74 


•0424 


•0343 


• 3541 


97. R-109 40 


• 3112 


• 3579 


•2923 


• 3041 


• 2)66 


• 2215 


.2231 


•2807 


• 2070 


.2*50 


•0382 


•0579 


• 2941 


91. R-llI 60 


•2577 


• 3224 


•2444 


• 2923 


*2664 


• 2346 


• 1868 


• 2805 


• 2235 


• 2531 


• 0947 


• 0394 


• 2522 


94. 1-111 40 


•5542 


• 3993 


• 3007 


• 3602 


• 3574 


.2581 


• 2191 


• 3495 


• 2738 


• 2978 


.14*9 


•0914 


• 3419 


60. R-112 60 


• 5941 


•4404 


• 3445 


•4440 


• 3396 


• 2764 


• 2056 


• 3918 


• 3120 


•41*0 


• 1320 


• 0903 


• 3924 


61 . R-113 60 


• 3420 


•4144 


• 3142 


• 4352 


• 3562 


• 2951 


• 1837 


• 3599 


• 3)6) 


• 320* 


•0997 


to 0499 


• 3909 


62. B-114 60 




•4212 


• 3559 


• 3704 


•2926 ' 


• 2728 


• 2459 


• 3547 


• 3173 


• 3091 


•0509 


•0902 


• 3907 


63. R-119 44 


•4212 


. 


•4091 


• 5)10 


• 3958 


• 3594 


• 2901 


•4774 


.4171 


•4497 


•0*92 


•0751 


•4924 


46. i-m M 


• 3559 


•4091 




• 3729 


• 2710 


• 2726 


• 2695 


.3978 


• 3128 


• 3797 


• 0704 


• 0403 


• 3347 


49. R-lSt 60 


• 5704 


•5510 


•3729 




• 3776 


• 3088 


.2287 


•4338 


• 4047 


• 4009 


• 0904 


• 0*05 


•4247 


46. R-139 M 


•2924 


• 3959 


•2710 


• 3776 


' 


• 2312 


• 1761 


• 3134 


• 2871 


• 277* 


•0997 


• 07*9 


• 3449 


<7. R-134 M 


•2729 


• 3594 


•2724 


• 3099 


• 2)12 




• 2175 


• 3142 


. .2424 


• 3087 


•0910 


•0*77 


• 2444 


60. R-139 60 


•2459 


•2901 


•2495 


• 2297 


• 1761 


• 2175 




• 2*53 


.1714 


.2514 


• 052S 


. .0555 


•2211 


•9. R.130 60 


•5947 


•4774 


•3979 


• 4339 


• 3134 


• 3142 


• 2653 




• 3449 


• 3933 


•0*51 


•0*3* 


• 3972 


70. 1-134 40 


•5175 


•4171 


• 3129 


•4047 


•2971 


• 2424 


• 1714 


• 3440 




• 310* 


•0*92 


•0374 


• 3742 


71. 1-160 40 


•5091 


•4497 


•3797 


•4009 


• 2776 


• 1097 


• 2514 


• 3833 


• 3106 




•0755 


•0*13 


• 3444 


7R. 1-itt 40 


•0509 


•0492 


•0704 


.0904 


•0997 


• 0910 


• 0525 


•0651 


• 0692 


• 0755 




• 0517 


• 0949 


73. 1-149 40 


•0902 


•0751 


•0403 


.0605 


•0749 


• 0477 


• 0555 


• 0636 


• 0376 


• 0*13 


•0517 


• 0959 


• 0959 


74. 1-lM 40 


•5907 


•4924 


• 3347 


•4247 


• 3449 


• 2666 


• 2211 


• 3972 


• 3 752 


• 344* 


• 0949 






•4209 


•5795 


• 3922 


•4699 


• 3490 


• 3242 


• 2679 


• 4712 


• 3917 


• 384* 


•0494 


• 0340 


•4304 


•4041 


•430r 


•4907 


• 5959 


•3759 


• 3295 


• 2662 


• 6089 


• 4303 


• 4555 


•0751 


• 0749 


• 5324 


77 . 1—143 40 


• 2952 


•3615 


•2549 


•3190 


• 2221 


• 2353 


• 16 74 


• 3217 


• 2612 


• 3172 


< .0297 


. .0370 


• 2992 


70. 1—213 40 


• 3356 


•4515 


•2991 


• 4499 


• 2931 


• 2729 


• 2129 


• 3630 


• 3146 


• 3437 


• 0392 


•0*15 


• 3952 


79 . 1—230 40 


• 3034 


• 3914 


•2510 


.3776 


• 2471 


• 2515 


• IH35 


• 3154 


• 2575 


• 30)4 


• 0435 


• 0443 


•2939 


10. 1-231 40 


•2441 


• 3149 


•2241 


.3316 


• 2194 


• 1741 


• 1174 


• 2611 


• 2965 


• 2546 


• 0339 


• 0299 


• 2741 


11. 1-233 40 


• 3494 


•4434 


• 3414 


.4394 


• 3028 


• 2829 


• 2065 


• 4068 


• 3417 


• 4100 


•0505 


• 0294 


• 3929 


42. R-233 40 


•2972 


• 3929 


•2952 


• 3920 


• 2523 


• 2525 


• 1675 


• 3267 


• 2889 


• 3325 


• 0417 


• 0147 


• 3212 


13<. R-234 40 


•2499 


• 3517 


• 2499 


.3499 


• 2290 


• 1886 


• 1288 


• 312) 


• 2820 


• 2891 


• 0205 


•002* 


• 2979 


04. R-23S 40 


• 3441 


•4334 


• 3229 


.3926 


• 2929 


• 3020 


• 2117 


• 4106 


• 2980 


•4041 


• 0304 


• 0292 


• 3720 


15. R-240 40 


•4417 


•4194 


•4594 


.5743 


• 3885 


• 37 70 


• 2813 


• 5278 


• 4)4) 


• 5630 


•0581 


• 0558 


• 5024 


44. R-2S0 40 


• 3549 


•4579 


• 3447 


.4077 


• 342V 


• 3204 


• 2308 


• 4016 


• 3218 


• )50) 


• 0100 


•0*59 


• 3934 


07. R-240 40 


• 3110 


• 3930 


•2993 


• 3305 


• 3179 


• 2)9i 


• 2120 


• 3114 


• 2746 


• 2910 


•0824 


•0517 


• 3965 


‘ 40. 1-270 40 


•2203 


•2444 


• 1977 


.2412 


• 2121 


• 1651 


• 1272 


• 1989 


• 2312 


• 1952 


• 0409 


• 0142 


• 2993 


19. 1-201 40 


•2354 


• 3079 


•2112 


.2492 


• 2458 


• 2169 


.1562 


• 2689 


• 2152 


• 2228 


•0)*3 


• 0238 


• 2990 


90. 1-202 40 


• 3120 


• 4114 


• 2931 


.3564 


• 2601 


• 241H 


• 1827 


• 3303 


• 3126 


• 3192 


• 0401 


•0352 


• 3620 


91. 1-290 40 


• 3499 


• 4511 


• 3990 


.4207 


• 3191 


• 2906 


• 2L95 


• 4607 


• 3424 


• 4107 


•0758 


• 0295 


• 4185 


92. 1-311 40 


• 4002 


• 4576 


• 3497 


.4166 


• 3202 


• 3040 


• 2267 


• 4142 


• 3312 


• 4127 


• 0445 


• 0453 


• 4210 


93. 1-312 40 


• 1240 


• 1043 


•0945 


•0790 


• 0877 


.0768 


• 0)58 


• 1004 


• 0 798 


• 0909 


• 0291 


• 0273 


•0917 


M. R-333 40 


• 2541 


• 2933 


• 1999 


• 3211 


• 2040 


• 187«« 


• 1252 


• 2661 


• 2867 


• 2221* 


• 010* 


• 049* 


• 2697 


95. F<410 40 


• 1424 


• 1539 


• 0922 


.1895 


• 1170 


• 0852 


.0203 


• 1204 


• 4788 


• 1296 


• 0515 


•0099 


• 170* 


94. F-420 40 


• 1504 


• 1595 


• 1400 


.1800 


• 0994 


• 1262 


• 0711 


• 1562 


• 1646 


• 1125 


• 02% 


• 0473 


• 1*49 


97. F-430 40 


• 1430 


• 14)1 


•0901 


.1562 


• 1308 


• 0988 


• 0613 


• 1378 


• 1474 


• 0826 


• 0205 


•0242 


• 177* 


91. F-440 40 


• 3299 


• 3974 


•2504 


.2998 


• 1981 


• 2287 


• 1820 


• 3102 


• 26H1 


.*l 769 


-.0005 


-•0004 


• 3758 


99. F*a01 40 





i 
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TABLE 1-2 (continued) 



Variabl# 



JB 4* 

iS 



2, 
3. 
4a 

6 . 
7. 
i. 

9. 
10 . 
11 . 
12 . 

13. 

14. 

15. 

16. 
17. 
li. 

19. 

20 . 
21 . 
22 . 

23. 

24. 

25. 

26 . 
27. 
20 . 
W. 
:io. 
IT. 

32. 

33. 

34. 

35. 

It. 

37. 
3i. 

39. 

40. 

41. 

42. 

in: 

44. 
,45. 

47. 
4a. 

51. 

52. 

53. 

54. 

55. 

56. 

57. 

58. 

59. 

60. 
61. 
62. 

63. 

64. 

65. 

66 . 

67. 

61. 

69. 

70. 

71. 

72. 

73. 

74. 

H: 

77. 

7T. 

81. 

62. 

83. 

84. 

tr. 

06. 

87. 

80. 

89. 

90. 

91. 

pr. 

93. 

94. 

*ir. 

96. 

97. 

98. 

99. 



31-102 63 
H-103 63 
8-104 63 
R-105 63 
8-106 63 
8-107 63 
8-108 63 
8-109 63 
8-110 63 
8-111 63 
8-112 63 
8-113 63 
8-114 63 
8-115 63 
8-^131 63 
8-132 63 
8-133 63 
8-134 63 
8-135 63 
8-138 63 
8-139 63 
8-140 63 
8-142 63 
8-145 63 
8-146 63 
8-147 63 
8-150 63 
8-162 63 
8-212 63 
8-220 63 
8-231 63 
8-232 63 
8-233 63 
R-234 63 
8-235 63 
8-240 63 
8-250 63 
8-260 63 
8-270 63 
8-281 63 
8-282 63 
8-290 63 
8-311 63 
8-312 63 
8-333 63 
F-410 63 
F-420 63 
F-430 63 
F-440 63 
8-102 60 
8-103 60 
8-104 60 
8-105 60 
8-106 60 
8-107 60 
8-100 60 
8-109 60 
8-110 60 
8-111 60 
8-112 60 
8-113 60 
8-114 60 
8-115 60 
8-131 60 
8-132 60 
8-133 60 
8-134 60 
8-135 60 
8-138 60 
8-139 60 
8-140 60 
8-142 60 
8-145 60 
8-146 60 

!8 

8-162 60 
8-212 60 
8-220 60 
8-231 60 



8-232 60 
R-233 60 
8-234 60 
8-235 60 
R-240 60 
8-250 60 
H-260 60 
8-270 60 
8-281 60 
8-202 60 
8-290 60 
8-311 60 
8-312 60 
R-333 60 
F-410 60 
F-420 60 
F-430 60 
F-440 60 
F*801 60 



Vocab. X 
Utaraturf 
Music 
Soc. Stud. 
Hath 

Physt, Scl. 

Bio. Sci. 

Sciant.Att 

Acro-Spaca 

Elactronic 

Machanica 

Faraing 

Homa Ec. 

Sports 

Art 

Law 

Haalth 

Engine 

Arch. 

Military 

AccttBual. 

Prac.Knowl 

Bibla 

Hunting 

Fishing 

Outdoor 

Thaatar 

Vocab. II 

Ma«. Words 

Diag. Wda. 

Spelling 

Capital. 

Punct. 

Eng. Uaaga 

Eff. Exp. 

Word.Funct 

8dg. Coapr 

Craativity 

Mach.Raaa 

Via. 2 Dia 

Via. 3 Dim 

Abat.Raaa 

Arith.Raaa 

Int.HSMath 

Adv.HSHath 

Arith.Coap 

Tahla 8aad 

Clar.Chach 

OhJ . Inap. 

Vocab. I 

Litaratura 

Music 

Soc. Stud. 

Math 

Phya. Sci. 

iio. Sci. 

Sciant.Att 

Aaro-Spaca 

Elactronic 

Machanica 

Farming 

Hoaa Ec. 

Sporta 

Art 

Lav 

Haalth 

Engin. 

Arch. 

Military 

Acct»iuai. 

Prac.Knowl 

iibla 

Hunting 

Fishing 

Qutdoov 

Thaatar 

Vocab. II 
Men. Words 
Diag. Wda. 
Spelling 
Capitel. 
Punct. 

Eng. Usage 
Eff. Exp. 
Word.Funct 
Rdg. Compr 
Creativity 
Mech.Reas 
Via. 2 Dim 
Vis.* 3 Dim 
Abet. Reas 
Arith.Reaa 
Int.HSMath 
Adv.HSMath 
Arith.Coap 
Table Read 
Clar. Check 
ObJ . Inap . 
Socioacon. 



76 


77 


ft) 






HI 




83 


84 


65 


66 


81 


• 5896 


.6774 


.<(36^ 


.‘i5UH 


.4647 


.1719 


.596 3 


.4891 


.4311 


.5514 


• 7460 




• 5796 


.6336 


• <«30i) 


.4954 


• 44b) 


. 5669 


.5704 


• 4855 


• 4102 


• 5501 


• 70/9 


.A734 


4 5H2 


.3901 


• s/rf 


. 494:1 




.3214 


• 5‘)/5 


.406) 


• 3686 


• 4372 


• 6259 




• 5232 


.6164 


• 42c)6 


. 4o4C 


.4159 


• 56^7 


.bMb 


.4492 


.3910 


• 5195 


• 6956 


•4549 ! 


• 4799 


•3467 


• 4IC4 


.4599 


• 92)7 


.1014 




.4131 


• 3621 


.5947 


• 6144 


.4754 


• 4700 


«S77S 


• 405b 


. 45v) \ 


.9942 


.5167 


• 5441 


.414? 


.3822 


• 5274 


• 6534 


.49)7 


«3949 


.3126 


• 3 34e> 


.4116 


• 1 1 5 5 


• 2647 


.449b 


. 53b2 


• 3206 


• 4332 


• 5911 


•4422 


• 3805 


.4755 




. 1 / ,) .1 


.2962 


.2 746 


.45H9 


.351 / 


• 1513 


• 4061 


• 5379 


.)9I4 


• 3I&84 


.3577 




. 1 




. IJ?96 




.2606 


• 2370 


• 3296 


• 4506 


.371) 


• 3095 


.3572 


• P446 


.2920 


• .^448 


• 20u>) 


. 5524 


.?8bl 


• 2 394 


• 5242 


• 4140 


.3672 


• 3199 


.4169 


•/y)t 


.2 ITH 


.2049 


.2298 


• 53)6 


• 2906 


• 2369 


• 2848 


• 4469 


•4291 


• 3794 


.4650 


• 2f^e 




.30b2 


. 510H 


.4196 


. 1561 


• 2Bb2 


• 3 724 


.5324 


.4054 


• 3134 


.4052 


• ?lbb 


.26?! 


.2010 


• 2591 


. 1221 


.;>62l 


• 2724 


• 2605 


• 4160 


.3502 


•4446 


•4334 


• iii5 


• 4‘M4 


• 506 7 


.2/61 


. 5955 


• 506? 


• 2/06 


• 3//2 


• 4967 


.3666 


• 5367 


.5771 


• 3353 


• 44M 


. 5464 


• 37)6 


*455/ 


.41)7 


• 5612 


• 4326 
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*Each correletlon In thin teble !■ baied on all caaaa having 
valid acoraa for both of the varlablaa corralatad. 

^Tha unvalghtad niabara of caaaa on which aach corralatlon 
coafflclant la baaad nay ba detatnlnad froai Tabla 2-5. 



Variable 

1. 8-102 63 

2. 8-103 43 

3. 8-104 63 

4. 8-105 63 

5. 8-106 63 

6. 8-107 63 

7. 8-108 63 

8 . 8-109 63 

9. 8-110 63 

10. 8-111 63 

11. 8-112 63 

12. 8-113 63 

13. 8-114 63 

14. 8-115 43 

15. 8-131 63 

16. 8-132 63 

17. 8-133 63 

18. 8-134 63 

19. 8-135 63 

20. 8-138 63 

21. 8-139 63 

22. 8-140 63 
234 8-142 63 

24. 8-145 63 

25 . 8-146 63 

26. 8-147 63 

27. 8-150 63 

28. 8-162 63 

29. 8-212 63 

30. 8-220 63 

31. 8-231 63 

32. 8-232 63 

33. 8-233 63 

34. 8-234 63 

35. 8-235 63 

36. 8-240 63 

37. 8-250 63 

38. 8-260 63 

39. 8-270 63 

40. 8-281 63 

41. 8-282 63 
4;e. 8-290 63 
43. 8-311 63 
44« 8-312 83 
45. 8-333 63 
48« f-410 83 

47. f-420 63 

48. f^30 63 

51. t-103 <0 

52. I-IM M 

53. t-lOS M 

54. k-lM M 
S3, t-107 M 
S«. i-lM M 
S7. t-lM M 
SI. 1^110 M 
St. I-IU M 

to. k-iu M 

«1. 1-113 M 
«2. 1-114 M 
43. k-liS M 
•4. R-131 M 
4S. 1-132 «• 
M. R-133 M 
47. R-134 40 
40. R.13S 40 
4t. R.1U M 

70. R-13t 40 

71. R-140 40 

72. R-142 40 

73. R-14S 10 

74. R-140 40 

H: l:il2 it 

77. R-142 40 
70. R-2U 40 
7t. R-220 40 
•0. R-231 40 
■1. R-232 40 
12. R-233 40 

03. R-234 40 

04. R-23S 40 
IS. R-240 40 
•4. R-2S0 40 
■7. R-240 40 
■I. R-270 40 
It. R-211 40 
to. R-202 40 
tl. R-2t0 60 
92. R-311 40 
t3. R-312 40 
94. R-333 60 
tS. r-410 60 

96. r-420 60 

97. r-430 60 
91. r-440 60 
99. 9*101 60 



APPENDIX J 



SIX MATRICES OF INTERCORRELATIONS AMONG 
TEST SCORE VARIABLES (GRADES 9 AND 12), 
SOCIOECONOMIC INDEX, NUMBER OF COURSES TAKEN IN SELECTED AREAS, 
TWO SIB ITEMS (COLLEGE PLANS AND AMOUNT OF COUNSELING). 
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TABLE J-2. Correlation Matrix AF( Retest Battery A. fenales ) 
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TABLE J-5. Correlation Matrix EM ( Retest Battery E, males) 
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TABLE J-6. Correlation Matrix EF( Ratast Battery E, females ) 
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See page J-18 for explanatory notes. 
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3 

These six matrices are based on cases that were In grade 9 In 1960 and grade 12 
In 1963 and who have retest classification code Oj and valid scores on all 
variables that are Included In the matrix. 

'^In the variable // code column In these tables, the designations of test score 
variables are preceded by the digit 0 or 3, representing 1960 (Grade 9) and 
1963 (Grade 12) scores respectively. Thus 0R250 and 3R250 represent the 1960 
and 1963 Reading Comprehension scores (R-250) respectively. 




iini 






n 






APPENDIX K 
NOTATION USED IN THIS REPORT 



o 

ERIC 









: -j 



K **2 



APPENDIX K. Notation Used in This Report 



Except where otherwise indicated, the following notation is used in this 
report. 



N » number of cases 



This is the unweighted number of cases entering into 
the computation of the statistic, except where it is 
explicitly indicated to mean weighted number of cases. 



n 



number of Items (In test) 



Variables 



X is any variable (usually, but not necessarily in raw score form) . 



z is a variable in standard score form, with a mean of 0 and a 
standard deviation of 1. 



Xg *» grade 9 raw score 

12 



X. » a grade 12 raw score 



Zg a grade 9 standard score 
^12 ~ 12 standard score 



D 

d 



raw score difference = X^^^ “ ^9 



where X 



12 



standard score difference 



12 



- z. 



and Xg are 



= residual score = X 



12*9 



for the same 
test 



M = mean 



M or X sample mean on variable X (» estimate of population mean) 

3C 



ERIC 






« standard deviation of sample, on variable X. 




Note: S.D. Is sometimes used Instead of s, as a row or 

column heading in tables. 



a * estimate of population standard deviation on variable X. 




r = reliability coefficient of variable X 

XX 

or ^ = standard error of measurement of variable X 

meas 

X 



a 

meas 

X 




a b 

00 00 



= r^^ corrected for attenuation 




df = number of degrees of freedom 



In factor analysis! 



th 

F, represents common factor. 



Three kinds of common factors — ^V-f actor, S-factor, and T-f actor — 
are identified in this research. They have the following meanings; 



A factor retained fiMm the varimax solution. 

S-factor 

A factor rotated subjectively after varimax. 

T~f actor 

A test-specific factor. 

T-factors are designated by the letter T, followed 
by the three-digit variable number corresponding to 
the test. For instance T-250 is the test-specific 
factor corresponding to R-250 (Reading Comprehension) . 



b^ = factor loading of variable i on common factor j (for any 
^ kind of common factor) 

b. = factor loading of test i on test-specific factor for that 
test 



Communality (computed) 



V-f actor 



Factor loadings 



a. . = factor loading of variable i on principal factor j 



h^ = communality of variable i = 




h. 

1 




+ b. 
1 



2 



communality of variable i which has a test- 
specific factor 



For other notation used in this report, see A 
the System of TALENT variable-number designations. 



see Appendix A, which describes 
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Copies of this report may be ordered from the American 
Institutes for Research. The price Is $5.00 per copy, post- 
paid. Orders should be addressed as follows: 



Until July 31, 1967: 

Project TALENT 

American Institutes for Research 
135 North Belief leld Avenue 
Pittsburgh, Pennsylvania 15213 



After July 31, 1967: 

Project TALENT 

American Institutes for Research 

Post Office Box 1113 

Palo Alto, California 94302 
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